00010000:00010000:2.0F:1789597050.172967:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0F:1789597050.306906:0:17026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1789597050.306951:0:17026:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7eb9b76900 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1789597050.306957:0:17026:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7eb9af6900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7eb9b76240 00000020:00080000:1.0:1789597050.306961:0:17026:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7eb9af6800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7ead4fa000 00000020:00080000:0.0F:1789597050.307061:0:17087:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:0.0:1789597050.307166:0:17087:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0F:1789597050.307264:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597050.307286:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597050.307296:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597050.307302:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5a00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597050.307308:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597050.307318:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597050.307339:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:3.0:1789597050.307342:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597050.307348:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597050.307355:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc0225 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18445 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597050.365387:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.365440:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.365474:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.365671:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746688 00000100:00100000:0.0:1789597050.365706:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746688 00000100:00100000:0.0:1789597050.365779:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746560 00000100:00100000:0.0:1789597050.365783:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746560 00000100:00100000:0.0:1789597050.365811:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:0.0:1789597050.365821:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961746688:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597050.365907:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb98d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961746688:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 87us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.365915:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 82 00000100:00100000:0.0:1789597050.365934:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00100000:0.0:1789597050.365942:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:2409:x1876527961746560:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597050.365974:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:2409:x1876527961746560:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.365981:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 83 00000100:00080000:0.0:1789597050.365996:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789597050.366001:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789597050.366656:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746432 00000100:00100000:1.0:1789597050.366665:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746432 00000100:00100000:1.0:1789597050.366738:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:1.0:1789597050.366746:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+13:2408:x1876527961746432:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789597050.366801:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+13:2408:x1876527961746432:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 56us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597050.366808:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:0.0:1789597050.375540:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.375590:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.375626:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.375658:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.375699:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.375723:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597050.375757:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746816 00000100:00100000:0.0:1789597050.375781:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746816 00000100:00100000:0.0:1789597050.375841:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961747328 00000100:00100000:0.0:1789597050.375844:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961747328 00000100:00100000:0.0:1789597050.375857:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961747456 00000100:00100000:0.0:1789597050.375859:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961747456 00000100:00100000:0.0:1789597050.375870:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961746944 00000100:00100000:0.0:1789597050.375872:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961746944 00000100:00100000:0.0:1789597050.375891:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1789597050.375900:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961746944:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597050.375991:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961746944:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.375998:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1789597050.376017:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789597050.376024:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2405:x1876527961746816:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1789597050.376044:0:18557:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff54 00000100:00080000:0.0:1789597050.376060:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7ec1f13800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789597050.376099:0:18557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789597050.376221:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+2:2405:x1876527961746816:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 197us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.376228:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:0.0:1789597050.376242:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789597050.376247:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2405:x1876527961747328:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1789597050.376258:0:18557:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff93 00000100:00080000:0.0:1789597050.376263:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f24000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789597050.376282:0:18557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789597050.376331:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+2:2405:x1876527961747328:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 83us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.376347:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789597050.376360:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1789597050.376367:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2405:x1876527961747456:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:0.0:1789597050.376378:0:18557:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff9a 00000100:00080000:0.0:1789597050.376384:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f25000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789597050.376401:0:18557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1789597050.376481:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+2:2405:x1876527961747456:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 114us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.376488:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:0.0:1789597050.376514:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961747072 00000100:00100000:0.0:1789597050.376518:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961747072 00000100:00100000:0.0:1789597050.376560:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961747200 00000100:00100000:0.0:1789597050.376564:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961747200 00000100:00100000:0.0:1789597050.376585:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:0.0:1789597050.376591:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961747072:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597050.376619:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961747072:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.376625:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 84 00000100:00100000:0.0:1789597050.376637:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00100000:0.0:1789597050.376643:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2409:x1876527961747200:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597050.376710:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d825f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2409:x1876527961747200:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 67us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597050.376717:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 85 00000100:00080000:0.0:1789597050.376734:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789597050.376738:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789597050.376748:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789597050.376750:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789597050.377172:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597050.377182:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789597050.884041:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789597051.197859:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597051.325424:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597051.325656:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984893696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597051.325774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597051.325894:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893696 00000100:00100000:0.0:1789597051.325908:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893696 00000100:00100000:0.0:1789597051.326011:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789597051.326022:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984893696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789597051.326076:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789597051.326135:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984893696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597051.326142:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789597051.326580:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984893952:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.326642:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.326704:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984894464:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.326733:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.326751:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984894976:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.326771:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.326791:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789597051.326804:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984893824:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.326834:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.326858:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984894336:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.326880:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.326897:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984894848:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.326916:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.326942:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984894208:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.326979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.326998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984894720:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327015:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.327029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984895232:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327046:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.327056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789597051.327071:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984894080:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327095:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.327111:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984894592:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327131:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.327149:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984895104:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327167:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597051.327188:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893952 00000100:00100000:3.0:1789597051.327195:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893952 00000100:00100000:3.0:1789597051.327226:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894336 00000100:00100000:3.0:1789597051.327229:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894336 00000100:00100000:3.0:1789597051.327244:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789597051.327251:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984893952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327313:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984893952:12345-0@lo:400:kworker.0 Request processed in 62us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327320:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789597051.327335:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789597051.327341:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984894336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327367:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984894336:12345-0@lo:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327372:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789597051.327389:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894464 00000100:00100000:3.0:1789597051.327392:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894464 00000100:00100000:3.0:1789597051.327422:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894080 00000100:00100000:3.0:1789597051.327425:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894080 00000100:00100000:3.0:1789597051.327438:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894592 00000100:00100000:3.0:1789597051.327440:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894592 00000100:00100000:3.0:1789597051.327455:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789597051.327460:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984894464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327490:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984894464:12345-0@lo:400:kworker.0 Request processed in 30us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327497:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789597051.327508:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789597051.327513:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984894080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327554:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984894080:12345-0@lo:400:kworker.0 Request processed in 41us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327559:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789597051.327570:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789597051.327575:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984894592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327618:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984894592:12345-0@lo:400:kworker.0 Request processed in 42us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327624:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789597051.327643:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894976 00000100:00100000:3.0:1789597051.327647:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894976 00000100:00100000:3.0:1789597051.327667:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894848 00000100:00100000:3.0:1789597051.327670:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894848 00000100:00100000:3.0:1789597051.327714:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894208 00000100:00100000:3.0:1789597051.327718:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894208 00000100:00100000:3.0:1789597051.327728:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984894720 00000100:00100000:3.0:1789597051.327731:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984894720 00000100:00100000:3.0:1789597051.327743:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984895232 00000100:00100000:3.0:1789597051.327746:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984895232 00000100:00100000:3.0:1789597051.327756:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984895104 00000100:00100000:3.0:1789597051.327758:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984895104 00000100:00100000:3.0:1789597051.327770:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789597051.327776:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984894976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327807:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984894976:12345-0@lo:400:kworker.0 Request processed in 31us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327813:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789597051.327823:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789597051.327829:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984894848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327870:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984894848:12345-0@lo:400:kworker.0 Request processed in 41us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327876:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789597051.327888:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789597051.327893:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984894208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327918:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984894208:12345-0@lo:400:kworker.0 Request processed in 25us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327929:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789597051.327941:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789597051.327946:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984894720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.327971:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984894720:12345-0@lo:400:kworker.0 Request processed in 25us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.327976:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789597051.327985:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789597051.327989:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984895232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328012:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876527984895232:12345-0@lo:400:kworker.0 Request processed in 23us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.328016:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789597051.328027:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789597051.328031:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984895104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328053:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876527984895104:12345-0@lo:400:kworker.0 Request processed in 22us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.328058:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789597051.328079:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984893824 00000100:00100000:3.0:1789597051.328082:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984893824 00000100:00100000:3.0:1789597051.328118:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789597051.328125:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:3647:x1876527984893824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328152:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f66223a4-de53-4574-9339-460f93dd2c76+24:3647:x1876527984893824:12345-0@lo:400:kworker.0 Request processed in 27us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597051.328158:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789597051.328249:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984894080:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328270:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984894592:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328280:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876527984895104:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328290:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984894208:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328299:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984894720:0@lo:400:kworker.0 00010000:00080000:3.0:1789597051.328310:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83ef9180 x1876527984895232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597051.328319:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984895232:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328366:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984893824:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984894336:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328388:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984894848:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328398:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984893952:0@lo:400:kworker.0 00000100:00100000:3.0:1789597051.328411:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984894464:0@lo:400:kworker.0 00010000:00080000:3.0:1789597051.328422:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83ef8a80 x1876527984894976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597051.328432:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984894976:0@lo:400:kworker.0 00000100:00080000:2.0:1789597051.329123:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597051.329131:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789597051.329134:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789597051.329136:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597051.329204:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984893696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597051.330865:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984895360:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597051.330960:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597051.333492:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984895360 00000100:00100000:2.0:1789597051.333507:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984895360 00000100:00100000:2.0:1789597051.333573:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789597051.333582:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984895360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789597051.333614:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789597051.333744:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984895360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597051.333751:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789597051.333809:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984895360:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789597052.226774:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597052.863222:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789597052.863247:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984895488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789597052.863320:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597052.863387:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984895488 00000100:00100000:2.0:1789597052.863395:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984895488 00000100:00100000:2.0:1789597052.863452:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789597052.863460:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984895488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789597052.863493:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597052.863552:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984895488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597052.863558:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789597052.863606:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984895488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789597053.134814:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597053.135228:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961747584 00000100:00100000:3.0:1789597053.135242:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961747584 00000100:00080000:2.0:1789597053.135393:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789597053.135546:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:3.0:1789597053.135570:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:15564:x1876527961747584:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789597053.135755:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:15564:x1876527961747584:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 197us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597053.135777:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:0.0:1789597053.150819:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597053.152357:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961747712 00000100:00100000:3.0:1789597053.152386:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961747712 00000100:00100000:3.0:1789597053.152498:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00100000:3.0:1789597053.152515:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:15564:x1876527961747712:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789597053.152721:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d831b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:15564:x1876527961747712:12345-192.168.202.16@tcp:60:lhsmtool_posix.0 Request processed in 211us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597053.152729:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 66 00000100:00080000:2.0:1789597053.153219:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597053.184110:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597053.184983:0:17049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961747968 00000100:00100000:3.0:1789597053.184997:0:17049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961747968 00000100:00100000:3.0:1789597053.185061:0:17049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789597053.185074:0:17049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:15564:x1876527961747968:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789597053.185408:0:17049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+14:15564:x1876527961747968:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 336us (1309us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789597053.185417:0:17049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00010000:00010000:2.0:1789597053.245531:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789597054.013144:0:17082:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789597054.013154:0:17082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789597054.013173:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789597054.013185:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789597054.268873:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597054.912661:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789597054.912710:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984895616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597054.912781:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597054.912843:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984895616 00000100:00100000:1.0:1789597054.912851:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984895616 00000100:00100000:1.0:1789597054.912897:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789597054.912905:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984895616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597054.912939:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789597054.912987:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984895616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597054.912993:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789597054.913061:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984895616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597054.914941:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597054.914964:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984895744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789597054.915041:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597054.915181:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984895744 00000100:00100000:0.0:1789597054.915188:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984895744 00000100:00100000:0.0:1789597054.915242:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789597054.915252:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984895744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789597054.915299:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597054.915344:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984895744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597054.915351:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789597054.916059:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984895744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597054.916774:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597054.916805:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb647d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984895872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597054.916862:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597054.916942:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984895872 00000100:00100000:0.0:1789597054.916950:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984895872 00000100:00100000:0.0:1789597054.917004:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789597054.917013:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984895872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597054.917050:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597054.917096:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984895872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597054.917103:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789597054.917256:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597054.917296:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb647d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984895872:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789597055.293821:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597055.481484:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597055.481527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597055.481548:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597055.481566:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597055.481587:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597055.481611:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597055.481881:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748096 00000100:00100000:3.0:1789597055.481894:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748096 00000100:00100000:3.0:1789597055.481945:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:3.0:1789597055.481955:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:2409:x1876527961748096:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597055.482581:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1face98e-a79e-4341-9221-d059c3bcf042+13:2409:x1876527961748096:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 623us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597055.482590:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:3.0:1789597055.482859:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748352 00000100:00100000:3.0:1789597055.482865:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748352 00000100:00100000:3.0:1789597055.482904:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748608 00000100:00100000:3.0:1789597055.482907:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748608 00000100:00100000:3.0:1789597055.482922:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748224 00000100:00100000:3.0:1789597055.482924:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748224 00000100:00100000:3.0:1789597055.482934:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748736 00000100:00100000:3.0:1789597055.482937:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748736 00000100:00100000:3.0:1789597055.482950:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:3.0:1789597055.482957:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961748352:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597055.483003:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961748352:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 46us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597055.483010:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 92 00000100:00100000:2.0:1789597055.484590:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748480 00000100:00100000:2.0:1789597055.484615:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748480 00000100:00100000:2.0:1789597055.484693:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789597055.484703:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961748480:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597055.484761:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961748480:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 60us (3172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597055.484768:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789597055.484790:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1789597055.484798:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961748608:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597055.484835:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961748608:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 38us (3286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597055.484842:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 93 00000100:00100000:2.0:1789597055.484855:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:2.0:1789597055.484861:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+14:2409:x1876527961748224:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597055.484881:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+14:2409:x1876527961748224:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (3314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597055.484886:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 94 00000100:00100000:2.0:1789597055.484895:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00100000:2.0:1789597055.484901:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb647ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2409:x1876527961748736:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597055.484918:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb647ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2409:x1876527961748736:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 18us (3307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597055.484923:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 95 00000100:00080000:3.0:1789597055.487181:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789597055.487189:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789597055.487192:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:2.0:1789597055.545541:0:20425:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 18:17:34 (1789597054) 00000001:00080000:2.0:1789597055.935865:0:17026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1789597055.935882:0:17026:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1789597055.935948:0:17087:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1789597055.935971:0:17087:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:1.0:1789597055.937139:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000020:00000080:1.0:1789597055.937146:0:19371:0:(genops.c:885:class_export_put()) final put ffff9c7d83f20800/cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000020:00000080:0.0:1789597055.937222:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83f20800/cded1d0b-04a6-4ab1-ac9e-f9279e87941c for lustre-OST0001 00000020:00000080:0.0:1789597055.937280:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83f25000 for lustre-OST0001 00000001:00100000:3.0:1789597055.937793:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000020:00000080:3.0:1789597055.937798:0:18551:0:(genops.c:885:class_export_put()) final put ffff9c7d83f23800/cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00100000:3.0:1789597055.937819:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000020:00000080:3.0:1789597055.937821:0:18551:0:(genops.c:885:class_export_put()) final put ffff9c7ec1f16800/7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000020:00000080:0.0:1789597055.937877:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83f23800/cded1d0b-04a6-4ab1-ac9e-f9279e87941c for lustre-OST0000 00000020:00000080:0.0:1789597055.937916:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ec1f16800/7aa843d4-eae2-4ed1-be92-0aea9eabc166 for lustre-OST0000 00000020:00000080:0.0:1789597055.937934:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83f24000 for lustre-OST0000 00000020:00000080:0.0:1789597055.937939:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ec1f13800 for lustre-OST0000 00010000:00010000:1.0:1789597056.316808:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597056.445851:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984896384:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446159:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446215:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984896896:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446255:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446275:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984897408:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446301:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446327:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789597056.446333:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb647ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984896000:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446367:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446387:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984896512:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446408:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446426:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984897024:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446445:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446460:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984897536:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446477:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446514:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb647d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984896128:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446539:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446560:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984896640:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446579:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446596:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984897152:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446616:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789597056.446632:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984896256:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.446652:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.446670:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984896768:0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.446937:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896000 00000100:00100000:1.0:1789597056.446958:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896000 00000100:00100000:1.0:1789597056.447022:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789597056.447032:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984896000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447097:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984896000:12345-0@lo:400:kworker.0 Request processed in 67us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447104:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789597056.447174:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897408 00000100:00100000:1.0:1789597056.447179:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897408 00000100:00100000:1.0:1789597056.447210:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896512 00000100:00100000:1.0:1789597056.447213:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896512 00000100:00100000:1.0:1789597056.447225:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897024 00000100:00100000:1.0:1789597056.447227:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897024 00000100:00100000:1.0:1789597056.447237:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897536 00000100:00100000:1.0:1789597056.447239:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897536 00000100:00100000:1.0:1789597056.447249:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897152 00000100:00100000:1.0:1789597056.447251:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897152 00000100:00100000:1.0:1789597056.447263:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789597056.447269:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984897408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447302:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984897408:12345-0@lo:400:kworker.0 Request processed in 33us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447308:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789597056.447328:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789597056.447334:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984896512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447363:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984896512:12345-0@lo:400:kworker.0 Request processed in 29us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447369:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789597056.447381:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789597056.447397:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984897024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447426:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984897024:12345-0@lo:400:kworker.0 Request processed in 39us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447431:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789597056.447442:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789597056.447447:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984897536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447473:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfacb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984897536:12345-0@lo:400:kworker.0 Request processed in 26us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447478:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789597056.447498:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789597056.447505:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984897152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447531:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984897152:12345-0@lo:400:kworker.0 Request processed in 27us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447537:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789597056.447566:0:19208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896384 00000100:00100000:1.0:1789597056.447570:0:19208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896384 00000100:00100000:1.0:1789597056.447599:0:19208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896896 00000100:00100000:1.0:1789597056.447602:0:19208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896896 00000100:00100000:1.0:1789597056.447615:0:19208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896256 00000100:00100000:1.0:1789597056.447617:0:19208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896256 00000100:00100000:1.0:1789597056.447632:0:19208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789597056.447646:0:19208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984896384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447706:0:19208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984896384:12345-0@lo:400:kworker.0 Request processed in 32us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447713:0:19208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789597056.447736:0:19208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789597056.447742:0:19208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfaca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984896896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447769:0:19208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfaca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984896896:12345-0@lo:400:kworker.0 Request processed in 29us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447775:0:19208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789597056.447784:0:19208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789597056.447789:0:19208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfaca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984896256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447812:0:19208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfaca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984896256:12345-0@lo:400:kworker.0 Request processed in 24us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447818:0:19208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789597056.447859:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896128 00000100:00100000:1.0:1789597056.447864:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896128 00000100:00100000:1.0:1789597056.447886:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896640 00000100:00100000:1.0:1789597056.447889:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896640 00000100:00100000:1.0:1789597056.447901:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789597056.447907:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984896128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447937:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984896128:12345-0@lo:400:kworker.0 Request processed in 30us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447942:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789597056.447953:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789597056.447958:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984896640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.447983:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984896640:12345-0@lo:400:kworker.0 Request processed in 25us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.447995:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789597056.448026:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789597056.448031:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789597056.448033:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789597056.448035:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789597056.448072:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb647ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984896000:0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.448089:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984896512:0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.448099:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984897024:0@lo:400:kworker.0 00010000:00080000:1.0:1789597056.448111:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e869bc700 x1876527984897536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597056.448121:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984897536:0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.448133:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83efad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984896384:0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.448142:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984896896:0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.448152:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984897408:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.449174:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.449208:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984897280:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.449230:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597056.449269:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb647d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984896128:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.449283:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984896640:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.449294:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984897152:0@lo:400:kworker.0 00000100:00100000:3.0:1789597056.449316:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984896256:0@lo:400:kworker.0 00000100:00100000:2.0:1789597056.449484:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789597056.449507:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984897664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597056.449542:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597056.449584:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897664 00000100:00100000:2.0:1789597056.449592:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897664 00000100:00100000:2.0:1789597056.449639:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789597056.449647:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984897664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789597056.449702:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789597056.449932:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984897664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 285us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597056.449940:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789597056.449995:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984897664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789597056.452126:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897280 00000100:00100000:0.0:1789597056.452143:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897280 00000100:00100000:0.0:1789597056.452212:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789597056.452221:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984897280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597056.452300:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984897280:12345-0@lo:400:kworker.0 Request processed in 81us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597056.452308:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1789597056.452332:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789597056.459201:0:19208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984896768 00000100:00100000:1.0:1789597056.459219:0:19208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984896768 00000100:00100000:1.0:1789597056.459290:0:19208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789597056.459300:0:19208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984896768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597056.459573:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebfacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984897792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597056.459667:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597056.459742:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897792 00000100:00100000:2.0:1789597056.459747:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897792 00000100:00100000:2.0:1789597056.459777:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789597056.459785:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984897792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789597056.459804:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789597056.459840:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984897792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597056.459847:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789597056.459901:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebfacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984897792:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789597056.461930:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597056.462839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984896768:0@lo:400:kworker.0 00010000:00080000:2.0:1789597056.462862:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e869bf100 x1876527984897280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597056.462873:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984897280:0@lo:400:kworker.0 00000100:00100000:1.0:1789597056.468365:0:19208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984896768:12345-0@lo:400:kworker.0 Request processed in 9047us (19175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597056.468399:0:19208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1789597057.352159:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597057.987146:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984897920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789597057.987219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597057.987381:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984897920 00000100:00100000:2.0:1789597057.987390:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984897920 00000100:00100000:2.0:1789597057.987450:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789597057.987462:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984897920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789597057.987503:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597057.987572:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984897920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597057.987579:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789597057.987723:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984897920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789597058.364864:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597059.393391:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597060.028955:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984898048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597060.029046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597060.029282:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898048 00000100:00100000:1.0:1789597060.029309:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898048 00000100:00100000:1.0:1789597060.029383:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789597060.029393:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984898048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597060.029433:0:17052:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789597060.029501:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984898048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597060.029508:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789597060.029556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984898048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597060.029822:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789597060.029833:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebfac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984898176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597060.029866:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597060.029903:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898176 00000100:00100000:3.0:1789597060.029907:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898176 00000100:00100000:3.0:1789597060.029943:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789597060.029950:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984898176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789597060.029968:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597060.030002:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfacb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984898176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597060.030008:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789597060.030044:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebfac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984898176:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789597060.030293:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597060.048950:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597060.048976:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984898304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597060.049058:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597060.049287:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898304 00000100:00100000:2.0:1789597060.049298:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898304 00000100:00100000:2.0:1789597060.049349:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789597060.049366:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984898304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789597060.049400:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597060.049487:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984898304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597060.049494:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789597060.053623:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984898304:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789597060.093867:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789597060.414570:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597060.601730:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597060.601787:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597060.601823:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597060.602411:0:17039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748864 00000100:00100000:0.0:1789597060.602423:0:17039:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748864 00000100:00100000:0.0:1789597060.602508:0:17039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:0.0:1789597060.602520:0:17039:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:2409:x1876527961748864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597060.602609:0:17039:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1face98e-a79e-4341-9221-d059c3bcf042+13:2409:x1876527961748864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 92us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597060.602617:0:17039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:0.0:1789597060.606651:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597060.611080:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597060.611123:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597060.613876:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961749120 00000100:00100000:2.0:1789597060.613891:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961749120 00000100:00100000:2.0:1789597060.613988:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961749376 00000100:00100000:2.0:1789597060.613991:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961749376 00000100:00100000:2.0:1789597060.614000:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961748992 00000100:00100000:2.0:1789597060.614002:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961748992 00000100:00100000:2.0:1789597060.614027:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:2.0:1789597060.614038:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961749120:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597060.614149:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961749120:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 112us (12361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597060.614157:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 102 00000100:00100000:2.0:1789597060.614175:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789597060.614182:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961749376:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597060.614209:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2409:x1876527961749376:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (12385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597060.614234:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 103 00000100:00100000:2.0:1789597060.614247:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00100000:2.0:1789597060.614254:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:2409:x1876527961748992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597060.614280:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:2409:x1876527961748992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (7641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597060.614287:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 104 00000100:00080000:2.0:1789597060.614313:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597060.614317:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597060.614772:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961749248 00000100:00100000:2.0:1789597060.614777:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961749248 00000100:00100000:2.0:1789597060.614811:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:2.0:1789597060.614816:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961749248:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597060.614847:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2409:x1876527961749248:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 32us (3790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597060.614851:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00080000:2.0:1789597060.614862:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789597060.620069:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961749504 00000100:00100000:3.0:1789597060.621483:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961749504 00000100:00100000:3.0:1789597060.621580:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00100000:3.0:1789597060.621587:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2409:x1876527961749504:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1789597060.621665:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2409:x1876527961749504:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 77us (10540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597060.621672:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 105 00000100:00080000:2.0:1789597060.622313:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597061.006070:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597061.008349:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961749760 00000100:00100000:0.0:1789597061.008368:0:17050:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961749760 00000100:00100000:0.0:1789597061.008458:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:0.0:1789597061.008468:0:17050:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+13:16318:x1876527961749760:12345-192.168.202.16@tcp:35:umount.0 00000001:00080000:0.0:1789597061.008765:0:17050:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1789597061.008858:0:17050:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1789597061.009011:0:17050:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+16:16318:x1876527961749760:12345-192.168.202.16@tcp:35:umount.0 Request processed in 543us (2951us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1789597061.009019:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000020:00080000:0.0:1789597061.009024:0:17050:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789597061.015331:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597061.015381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597061.015411:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597061.015468:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597061.015572:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961749888 00000100:00100000:1.0:1789597061.015582:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961749888 00000100:00100000:1.0:1789597061.015642:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789597061.015654:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2405:x1876527961749888:12345-192.168.202.16@tcp:9:umount.0 00000020:00000080:1.0:1789597061.015718:0:18556:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff5b 00000100:00080000:1.0:1789597061.015731:0:18556:0:(import.c:65:import_set_state_nolock()) ffff9c7d831a1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789597061.015775:0:18556:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789597061.015932:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7aa843d4-eae2-4ed1-be92-0aea9eabc166+2:2405:x1876527961749888:12345-192.168.202.16@tcp:9:umount.0 Request processed in 279us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597061.015940:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:1.0:1789597061.015962:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961750016 00000100:00100000:1.0:1789597061.015966:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961750016 00000100:00100000:1.0:1789597061.015996:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961750272 00000100:00100000:1.0:1789597061.015999:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961750272 00000100:00100000:1.0:1789597061.016008:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961750144 00000100:00100000:1.0:1789597061.016025:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961750144 00000100:00100000:1.0:1789597061.016043:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1789597061.016051:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1face98e-a79e-4341-9221-d059c3bcf042+15:2407:x1876527961750016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597061.016064:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597061.016087:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e4e00/0x7b5398e289bbff31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ca2 expref: 15 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597061.016110:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597061.016144:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1face98e-a79e-4341-9221-d059c3bcf042+14:2407:x1876527961750016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 93us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597061.016151:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1789597061.016166:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789597061.016172:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1face98e-a79e-4341-9221-d059c3bcf042+13:2407:x1876527961750272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597061.016180:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597061.016188:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a1400/0x7b5398e289bbffbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d89 expref: 13 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597061.016198:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597061.016214:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1face98e-a79e-4341-9221-d059c3bcf042+12:2407:x1876527961750272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597061.016219:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789597061.016258:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789597061.016265:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1face98e-a79e-4341-9221-d059c3bcf042+11:2407:x1876527961750144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597061.016272:0:17032:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597061.016281:0:17032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e4800/0x7b5398e289bbff38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07cd3 expref: 11 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597061.016300:0:17032:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597061.016318:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1face98e-a79e-4341-9221-d059c3bcf042+10:2407:x1876527961750144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 54us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597061.016325:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00010000:00010000:1.0:1789597061.016342:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597061.033801:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597061.033916:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961751168 00000100:00100000:1.0:1789597061.033927:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961751168 00000100:00100000:1.0:1789597061.033997:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 67 00000100:00100000:1.0:1789597061.034008:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+16:2405:x1876527961751168:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:1.0:1789597061.034051:0:18445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff46 00000020:00010000:1.0:1789597061.034068:0:18445:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7d84676800: total 0 00000100:00080000:1.0:1789597061.034072:0:18445:0:(import.c:65:import_set_state_nolock()) ffff9c7d84676000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789597061.034153:0:18445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1789597061.034320:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7aa843d4-eae2-4ed1-be92-0aea9eabc166+15:2405:x1876527961751168:12345-192.168.202.16@tcp:39:umount.0 Request processed in 314us (530us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1789597061.034328:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 67 00000020:00010000:3.0:1789597061.035028:0:17034:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7d84676800: total 0 00010000:00010000:3.0:1789597061.035036:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597061.035096:0:17034:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7d84676800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789597061.035138:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:3.0:1789597061.035142:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789597061.035152:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5800/0x7b5398e289bc01a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e0e expref: 14 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035174:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7d8259c000) 00010000:00010000:3.0:1789597061.035176:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789597061.035181:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4600/0x7b5398e289bc0011 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d90 expref: 13 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035201:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7eb9a7ff00) 00010000:00010000:3.0:1789597061.035204:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789597061.035207:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc00f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dcf expref: 12 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035225:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:3.0:1789597061.035227:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789597061.035231:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4400/0x7b5398e289bc016f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07df9 expref: 11 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035262:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c7d8259ca00) 00010000:00010000:3.0:1789597061.035265:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789597061.035269:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0256 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e46 expref: 10 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035284:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7d8259c500) 00010000:00010000:3.0:1789597061.035286:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597061.035289:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4c00/0x7b5398e289bc002d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d97 expref: 9 pid: 18445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035304:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7d8259c300) 00010000:00010000:3.0:1789597061.035307:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789597061.035310:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5600/0x7b5398e289bc01fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e23 expref: 8 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035324:0:17034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:3.0:1789597061.035326:0:17034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789597061.035330:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc006c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07da5 expref: 7 pid: 17047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597061.035341:0:17034:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7d84676800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1789597061.035356:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597061.035359:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597061.035360:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597061.054336:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597061.054796:0:17048:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961751296 00000100:00100000:3.0:1789597061.054810:0:17048:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961751296 00000100:00100000:3.0:1789597061.054886:0:17048:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 68 00000100:00100000:3.0:1789597061.054914:0:17048:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+5:2405:x1876527961751296:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:3.0:1789597061.054952:0:17048:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff4d 00000100:00080000:3.0:1789597061.054983:0:17048:0:(import.c:65:import_set_state_nolock()) ffff9c7ec1f13000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789597061.055012:0:17048:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1789597061.055074:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597061.055259:0:17048:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7aa843d4-eae2-4ed1-be92-0aea9eabc166+3:2405:x1876527961751296:12345-192.168.202.16@tcp:39:umount.0 Request processed in 347us (933us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789597061.055268:0:17048:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 68 00010000:00010000:3.0:1789597061.438565:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597061.565075:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597061.565110:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984898432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789597061.565193:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597061.565233:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898432 00000100:00100000:3.0:1789597061.565242:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898432 00000100:00100000:1.0:1789597061.565267:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebfac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984898560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597061.565294:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597061.565302:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789597061.565314:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984898432:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789597061.565340:0:18559:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00002000:00000024:3.0:1789597061.565345:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789597061.565351:0:18559:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1789597061.565408:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984898432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597061.565415:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789597061.565431:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898560 00000100:00100000:3.0:1789597061.565435:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898560 00000100:00100000:3.0:1789597061.565468:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789597061.565475:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984898560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789597061.565486:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789597061.565514:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984898560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597061.565520:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789597061.565568:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebfac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984898560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597061.565582:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984898432:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789597061.565906:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789597061.566548:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789597061.566610:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597061.566625:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984898816:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.566674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597061.566742:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898816 00000100:00100000:0.0:1789597061.566747:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898816 00000100:00100000:0.0:1789597061.566785:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789597061.566793:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984898816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.566852:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984898816:12345-0@lo:400:kworker.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597061.566860:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789597061.566894:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984898816:0@lo:400:kworker.0 00000100:00100000:3.0:1789597061.577460:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984898688:0@lo:400:kworker.0 00000100:00100000:3.0:1789597061.577913:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597061.578013:0:17040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898688 00000100:00100000:1.0:1789597061.578024:0:17040:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898688 00000100:00100000:1.0:1789597061.578081:0:17040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789597061.578093:0:17040:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:3645:x1876527984898688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597061.578165:0:17040:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f66223a4-de53-4574-9339-460f93dd2c76+24:3645:x1876527984898688:12345-0@lo:400:kworker.0 Request processed in 74us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597061.578173:0:17040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789597061.578368:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984898688:0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.578634:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597061.578646:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984898944:0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.578705:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597061.578740:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984898944 00000100:00100000:2.0:1789597061.578744:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984898944 00000100:00100000:2.0:1789597061.578797:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789597061.578805:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984898944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.578846:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984898944:12345-0@lo:400:kworker.0 Request processed in 42us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597061.578852:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789597061.578870:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597061.578901:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984898944:0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.578933:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984899072:0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.578972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597061.579174:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899072 00000100:00100000:2.0:1789597061.579179:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899072 00000100:00100000:2.0:1789597061.579207:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789597061.579214:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984899072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.579250:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984899072:12345-0@lo:400:kworker.0 Request processed in 36us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597061.579257:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789597061.579283:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984899072:0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.579326:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597061.579332:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984899456:0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.579356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597061.579382:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899456 00000100:00100000:2.0:1789597061.579386:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899456 00000100:00100000:2.0:1789597061.579410:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789597061.579415:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984899456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.579540:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984899200:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.579574:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597061.579597:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597061.579603:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984899328:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.579623:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597061.579649:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899200 00000100:00100000:0.0:1789597061.579654:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899200 00000100:00100000:0.0:1789597061.579697:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789597061.579704:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984899200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.579741:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984899200:12345-0@lo:400:kworker.0 Request processed in 38us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597061.579747:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789597061.579766:0:18556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899328 00000100:00100000:0.0:1789597061.579770:0:18556:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899328 00000100:00100000:0.0:1789597061.579791:0:18556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789597061.579797:0:18556:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984899328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.579826:0:18556:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984899328:12345-0@lo:400:kworker.0 Request processed in 29us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597061.579832:0:18556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789597061.579862:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984899328:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.579871:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984899200:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.579950:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984899712:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.580077:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597061.580119:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597061.580125:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984899840:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.580149:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597061.580200:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899712 00000100:00100000:0.0:1789597061.580203:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899712 00000100:00100000:0.0:1789597061.580226:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899840 00000100:00100000:0.0:1789597061.580229:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899840 00000100:00100000:0.0:1789597061.580243:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789597061.580248:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.580282:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984899712:12345-0@lo:400:kworker.0 Request processed in 34us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597061.580288:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789597061.580298:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789597061.580303:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984899840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.580328:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984899840:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597061.580334:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789597061.580351:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984899584:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.580372:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597061.580389:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789597061.580394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984899968:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.580411:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597061.580569:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e92d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984899456:12345-0@lo:400:kworker.0 Request processed in 1153us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597061.580588:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789597061.580601:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899584 00000100:00100000:2.0:1789597061.580604:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899584 00000100:00100000:2.0:1789597061.580619:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984899968 00000100:00100000:2.0:1789597061.580622:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984899968 00000100:00100000:2.0:1789597061.580634:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789597061.580639:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984899584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.580668:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984899584:12345-0@lo:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597061.580673:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789597061.580699:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789597061.580704:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984899968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597061.580730:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984899968:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597061.580735:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1789597061.580749:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597061.580754:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597061.580787:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984899840:0@lo:400:kworker.0 00010000:00080000:2.0:1789597061.580799:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8442c000 x1876527984899712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597061.580810:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984899712:0@lo:400:kworker.0 00010000:00080000:0.0:1789597061.581112:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83695c00 x1876527984899968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597061.581136:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984899968:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.581148:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984899584:0@lo:400:kworker.0 00000100:00100000:0.0:1789597061.581160:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984899456:0@lo:400:kworker.0 00010000:00010000:1.0:1789597062.460963:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597063.101888:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789597063.105360:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984900096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597063.105482:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597063.105709:0:18558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900096 00000100:00100000:3.0:1789597063.105718:0:18558:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900096 00000100:00100000:3.0:1789597063.105787:0:18558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789597063.105796:0:18558:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984900096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789597063.105833:0:18558:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597063.105879:0:18558:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984900096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597063.105886:0:18558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789597063.106375:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597063.106503:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984900096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789597063.485121:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597063.634175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597063.634218:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597063.634252:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597063.634287:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961751424 00000100:00100000:3.0:1789597063.634297:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961751424 00000100:00100000:3.0:1789597063.634347:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961751552 00000100:00100000:3.0:1789597063.634350:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961751552 00000100:00100000:3.0:1789597063.634362:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961751680 00000100:00100000:3.0:1789597063.634365:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961751680 00000100:00100000:3.0:1789597063.634382:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789597063.634391:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1face98e-a79e-4341-9221-d059c3bcf042+12:2406:x1876527961751424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597063.634409:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597063.634436:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bbff70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d12 expref: 12 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597063.634610:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789597063.634620:0:18581:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1face98e-a79e-4341-9221-d059c3bcf042+11:2407:x1876527961751552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597063.634629:0:18581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597063.634652:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bbff77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d43 expref: 11 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597063.634664:0:18581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597063.634764:0:18581:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfac8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1face98e-a79e-4341-9221-d059c3bcf042+10:2407:x1876527961751552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 145us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597063.634771:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789597063.634789:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1789597063.634795:0:18581:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfacb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1face98e-a79e-4341-9221-d059c3bcf042+9:2407:x1876527961751680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597063.634828:0:18581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597063.634838:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e5400/0x7b5398e289bbffb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07d82 expref: 9 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597063.634848:0:18581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597063.634864:0:18581:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfacb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1face98e-a79e-4341-9221-d059c3bcf042+8:2407:x1876527961751680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 70us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597063.634871:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00010000:00010000:3.0:1789597063.635387:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597063.636563:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1face98e-a79e-4341-9221-d059c3bcf042+7:2406:x1876527961751424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2163us (2388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597063.636576:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789597063.656074:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597063.656179:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961751936 00000100:00100000:2.0:1789597063.656190:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961751936 00000100:00100000:2.0:1789597063.656309:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 69 00000100:00100000:2.0:1789597063.656320:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+6:2405:x1876527961751936:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:2.0:1789597063.656362:0:17047:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff85 00000020:00010000:2.0:1789597063.656370:0:17047:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7eb5584000: total 0 00000100:00080000:2.0:1789597063.656375:0:17047:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c8b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789597063.656414:0:17047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1789597063.656578:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2405:x1876527961751936:12345-192.168.202.16@tcp:39:umount.0 Request processed in 259us (514us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789597063.656597:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 69 00000020:00010000:1.0:1789597063.658567:0:17035:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7eb5584000: total 0 00010000:00010000:1.0:1789597063.658664:0:17035:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7eb5584000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789597063.658736:0:17035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb65a2000) 00010000:00010000:1.0:1789597063.658740:0:17035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789597063.658752:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1600/0x7b5398e289bc007a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07dac expref: 4 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597063.658779:0:17035:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7eb5584000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789597063.658791:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597063.658793:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597063.658795:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789597063.663620:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597063.665259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597063.665336:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961752064 00000100:00100000:0.0:1789597063.665346:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961752064 00000100:00100000:0.0:1789597063.665492:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 70 00000100:00100000:0.0:1789597063.665504:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+5:2405:x1876527961752064:12345-192.168.202.16@tcp:39:umount.0 00000020:00000080:0.0:1789597063.665545:0:18445:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff8c 00000100:00080000:0.0:1789597063.665555:0:18445:0:(import.c:65:import_set_state_nolock()) ffff9c7ec1f0a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789597063.665585:0:18445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1789597063.665768:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cded1d0b-04a6-4ab1-ac9e-f9279e87941c+3:2405:x1876527961752064:12345-192.168.202.16@tcp:39:umount.0 Request processed in 266us (516us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789597063.665775:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 70 00010000:00010000:1.0:1789597063.666646:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789597063.668646:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597063.711740:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597063.711828:0:17041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961752320 00000100:00100000:3.0:1789597063.711839:0:17041:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961752320 00000100:00100000:3.0:1789597063.711904:0:17041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:3.0:1789597063.711913:0:17041:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+7:2405:x1876527961752320:12345-192.168.202.16@tcp:251:umount.0 00000020:00000080:3.0:1789597063.711966:0:17041:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbff23 00000020:00010000:3.0:1789597063.711980:0:17041:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7d84673000: total 0 00000100:00080000:3.0:1789597063.711985:0:17041:0:(import.c:65:import_set_state_nolock()) ffff9c7d84670000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789597063.712435:0:17035:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7d84673000: total 0 00010000:00010000:2.0:1789597063.712439:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597063.712493:0:17035:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7d84673000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789597063.712529:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bbff2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07c9b expref: 3 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597063.712546:0:17035:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7d84673000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789597063.712556:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597063.712558:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597063.712559:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597063.712647:0:17041:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1face98e-a79e-4341-9221-d059c3bcf042+1:2405:x1876527961752320:12345-192.168.202.16@tcp:251:umount.0 Request processed in 734us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597063.712655:0:17041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 177 00000020:00000080:3.0:1789597063.712665:0:17041:0:(genops.c:885:class_export_put()) final put ffff9c7d84673000/1face98e-a79e-4341-9221-d059c3bcf042 00000020:00000080:1.0:1789597063.712800:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d84673000/1face98e-a79e-4341-9221-d059c3bcf042 for MGS 00000020:00000080:1.0:1789597063.712844:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d84670000 for MGS 00000040:00080000:3.0:1789597064.253133:0:17082:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789597064.253144:0:17082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789597064.253166:0:17082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789597064.253176:0:17082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789597064.510623:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597065.158423:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984900224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597065.158504:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597065.158574:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789597065.158580:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984900352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597065.158606:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597065.158636:0:20534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900224 00000100:00100000:1.0:1789597065.158644:0:20534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900224 00000100:00080000:3.0:1789597065.158765:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597065.158845:0:20534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789597065.158855:0:20534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984900224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789597065.158885:0:20534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789597065.158946:0:20534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984900224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597065.158953:0:20534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789597065.159041:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984900224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789597065.159123:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900352 00000100:00100000:2.0:1789597065.159129:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900352 00000100:00100000:2.0:1789597065.159170:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789597065.159179:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984900352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597065.159208:0:17053:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789597065.159267:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984900352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597065.159274:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789597065.159282:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984900352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597065.166976:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984900480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597065.167056:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597065.167213:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900480 00000100:00100000:2.0:1789597065.167222:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900480 00000100:00100000:2.0:1789597065.167286:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789597065.167296:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984900480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789597065.167334:0:17788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597065.176225:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984900480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8915us (9154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597065.176246:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789597065.176531:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984900480:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789597065.532917:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789597066.156287:0:20621:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789597066.180553:0:20621:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789597066.180615:0:20621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.180631:0:20621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.180655:0:20621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.180663:0:20621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.180716:0:20621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789597066.180723:0:20621:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789597066.180753:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789597066.180757:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789597066.180763:0:20621:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789597066.180791:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7d83da9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789597066.180824:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984900608:0@lo:39:umount.0 00000100:00100000:0.0:1789597066.180899:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789597066.181365:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597066.181374:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.181382:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597066.181386:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.181395:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597066.181414:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597066.181421:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789597066.181423:0:17034:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789597066.181426:0:17034:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789597066.181455:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.181463:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597066.181492:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.181500:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bbfae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfaed expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.181525:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597066.181527:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597066.181539:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597066.181555:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900608 00000100:00100000:2.0:1789597066.181562:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900608 00000100:00100000:2.0:1789597066.181627:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789597066.181637:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876527984900608:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789597066.181662:0:17047:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb17 00000100:00080000:2.0:1789597066.181670:0:17047:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5586000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789597066.181754:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1876527984900608:12345-0@lo:39:umount.0 Request processed in 119us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597066.181762:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1789597066.181770:0:17047:0:(genops.c:885:class_export_put()) final put ffff9c7eb5587800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1789597066.181794:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789597066.181804:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984900736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597066.181835:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789597066.181864:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789597066.181873:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5587800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789597066.181919:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb5586000 for lustre-MDT0000 00000100:00100000:2.0:1789597066.184582:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900736 00000100:00100000:2.0:1789597066.184594:0:18581:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900736 00000100:00100000:2.0:1789597066.184668:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597066.184705:0:18581:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f66223a4-de53-4574-9339-460f93dd2c76+24:3646:x1876527984900736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597066.184723:0:18581:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597066.184742:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510800/0x7b5398e289bbfaed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfae6 expref: 24 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.184777:0:18581:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597066.184861:0:18581:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f66223a4-de53-4574-9339-460f93dd2c76+23:3646:x1876527984900736:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597066.184868:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789597066.184919:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83da9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789597066.184938:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984900608:0@lo:39:umount.0 00000100:00100000:1.0:1789597066.185466:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f66223a4-de53-4574-9339-460f93dd2c76:3646:1876527984900736:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789597066.185559:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789597066.185563:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789597066.185568:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789597066.188361:0:20621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.188380:0:20621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.188389:0:20621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.188396:0:20621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.188483:0:20621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597066.188491:0:20621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.188498:0:20621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.188505:0:20621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.188511:0:20621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188627:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597066.188637:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188645:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ec2052e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597066.188648:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188657:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597066.188665:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597066.188671:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789597066.188673:0:17034:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789597066.188736:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188743:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597066.188781:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188798:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052e00/0x7b5398e289bbfa37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfa3e expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188812:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597066.188815:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188821:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597066.188824:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188831:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597066.188837:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597066.188841:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789597066.188843:0:17034:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1789597066.188872:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188878:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597066.188885:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597066.188893:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597066.188895:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597066.188897:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597066.188981:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984900864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789597066.189059:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597066.189141:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984900992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789597066.189552:0:20621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789597066.189559:0:20621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98db400/0x7b5398e289bbfe43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfe4a expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789597066.189571:0:20621:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789597066.189579:0:20621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189587:0:20621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189594:0:20621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189600:0:20621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189620:0:20621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597066.189625:0:20621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189632:0:20621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189639:0:20621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189645:0:20621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597066.189652:0:20621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789597066.189654:0:20621:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789597066.189656:0:20621:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789597066.189708:0:20621:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789597066.189713:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789597066.189717:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597066.189723:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1789597066.189729:0:20621:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7d83c8f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789597066.189734:0:20621:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7d83ee3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789597066.189738:0:20621:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7e87561000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789597066.189742:0:20621:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c7e9d7d7800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789597066.189750:0:20621:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c7eb5584000 cded1d0b-04a6-4ab1-ac9e-f9279e87941c 192.168.202.16@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1789597066.189755:0:20621:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c7d84676800 7aa843d4-eae2-4ed1-be92-0aea9eabc166 192.168.202.16@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1789597066.189766:0:20621:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9c7d835119c0) has exports, disconnecting them 00000020:00080000:0.0:1789597066.189770:0:20621:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7d83c8f000), last request at 1789597061 00000020:00000080:0.0:1789597066.189780:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfe12 00000100:00080000:0.0:1789597066.189802:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c88000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789597066.189857:0:20621:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d83c8f000): rc 0 00000020:00000080:0.0:1789597066.189860:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7d83c8f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789597066.189871:0:20621:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7d83ee3000), last request at 1789597061 00000020:00000080:0.0:1789597066.189874:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfcb4 00000100:00080000:0.0:1789597066.189880:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7d83ee0000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789597066.189887:0:20621:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d83ee3000): rc 0 00000020:00000080:0.0:1789597066.189889:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7d83ee3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789597066.189892:0:20621:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7e87561000), last request at 1789596978 00000020:00000080:0.0:1789597066.189895:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfc0c 00000100:00080000:0.0:1789597066.189898:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7e87561800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789597066.189903:0:20621:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e87561000): rc 0 00000020:00000080:0.0:1789597066.189904:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e87561000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789597066.189908:0:20621:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c7e9d7d7800), last request at 1789596978 00000020:00000080:0.0:1789597066.189911:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb9c 00000100:00080000:0.0:1789597066.189914:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7eb98c5000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789597066.190187:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789597066.190195:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190204:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789597066.190207:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190215:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789597066.190222:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597066.190227:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789597066.190230:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789597066.190232:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789597066.190260:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190266:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789597066.190288:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190295:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0000/0x7b5398e289bbffee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfff5 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190305:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597066.190316:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190323:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ec2052200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789597066.190325:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190332:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789597066.190338:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597066.190344:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789597066.190346:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789597066.190348:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789597066.190361:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190367:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789597066.190374:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190380:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052200/0x7b5398e289bbfa29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfa30 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.190391:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597066.190392:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597066.190394:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597066.190416:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984901248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789597066.190458:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597066.190524:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1789597066.190552:0:20621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1789597066.190642:0:20621:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e9d7d7800): rc 0 00000004:00000080:0.0:1789597066.190650:0:20621:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc0dc419cfae0 00000100:00080000:0.0:1789597066.190669:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789597066.190673:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789597066.191540:0:20621:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789597066.191565:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1789597066.192302:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c8f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789597066.192370:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83ee3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789597066.192392:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e87561000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789597066.192422:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c88000 for lustre-MDT0000 00000020:00000080:0.0:1789597066.192428:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83ee0000 for lustre-MDT0000 00000020:00000080:0.0:1789597066.192431:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e87561800 for lustre-MDT0000 00010000:00010000:0.0:1789597066.192444:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597066.193943:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789597066.193965:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984901120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789597066.194046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597066.194471:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900864 00000100:00100000:0.0:1789597066.194481:0:18581:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900864 00000100:00100000:0.0:1789597066.194624:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984901248 00000100:00100000:0.0:1789597066.194629:0:18581:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984901248 00000100:00100000:2.0:1789597066.194656:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984900992 00000100:00100000:2.0:1789597066.194660:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984900992 00000100:00100000:2.0:1789597066.194707:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984901376:0@lo:39:umount.0 00000100:00100000:2.0:1789597066.194743:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.194776:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984901376 00000100:00100000:2.0:1789597066.194780:0:17053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984901376 00000100:00100000:2.0:1789597066.194809:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789597066.194817:0:17053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876527984901376:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789597066.194848:0:17053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfc2f 00000100:00080000:2.0:1789597066.194856:0:17053:0:(import.c:65:import_set_state_nolock()) ffff9c7e87565800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789597066.194880:0:17053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789597066.195015:0:17053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3643:x1876527984901376:12345-0@lo:39:umount.0 Request processed in 197us (270us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789597066.195275:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789597066.195327:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789597066.195335:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984901376:0@lo:39:umount.0 00000100:00100000:1.0:1789597066.195431:0:17031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789597066.195442:0:17031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+25:3644:x1876527984900864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789597066.195453:0:17031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597066.195474:0:17031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dcc00/0x7b5398e289bbfa3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfa37 expref: 25 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.195491:0:17031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597066.195763:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984901120 00000100:00100000:3.0:1789597066.195768:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984901120 00000100:00100000:3.0:1789597066.195793:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597066.195799:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+25:3647:x1876527984901248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597066.195807:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597066.195816:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dd800/0x7b5398e289bbfa30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfa29 expref: 25 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.195826:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597066.195853:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+24:3647:x1876527984901248:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (5396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597066.195859:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597066.195873:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789597066.195878:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+23:3645:x1876527984900992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597066.195885:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597066.195893:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742800/0x7b5398e289bbfe4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfe43 expref: 23 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.195902:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597066.195939:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+22:3645:x1876527984900992:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (5414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597066.195946:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789597066.195959:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789597066.195964:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+21:3647:x1876527984901120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597066.195986:0:17033:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597066.195993:0:17033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dac00/0x7b5398e289bbfff5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbffee expref: 21 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597066.196002:0:17033:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597066.196248:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f66223a4-de53-4574-9339-460f93dd2c76+20:3647:x1876527984901120:12345-0@lo:103:ldlm_bl.0 Request processed in 283us (2202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597066.196255:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789597066.196280:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597066.196306:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984901120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789597066.196317:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984901248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597066.196379:0:17031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f66223a4-de53-4574-9339-460f93dd2c76+19:3644:x1876527984900864:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (6475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597066.196386:0:17031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789597066.197354:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984900992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597066.197386:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984900864:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789597066.198477:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789597066.198484:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789597066.198498:0:20621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789597066.198571:0:20621:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789597066.198597:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789597066.198612:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789597066.198614:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789597066.198621:0:20621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789597066.198697:0:20621:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789597066.198706:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789597066.198746:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c7d835119c0) has no exports 00000001:00100000:0.0:1789597066.199760:0:17026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789597066.199767:0:17026:0:(genops.c:885:class_export_put()) final put ffff9c7e9d7d7800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789597066.199790:0:17026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00080000:0.0:1789597066.199799:0:17026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1789597066.199803:0:17026:0:(genops.c:885:class_export_put()) final put ffff9c7eb5584000/cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00100000:0.0:1789597066.199808:0:17026:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000001:00080000:0.0:1789597066.199815:0:17026:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1789597066.199821:0:17026:0:(genops.c:885:class_export_put()) final put ffff9c7d84676800/7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000100:00100000:2.0:1789597066.199977:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984901504:0@lo:9:umount.0 00000100:00100000:2.0:1789597066.200057:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.200294:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984901632:0@lo:9:umount.0 00000100:00100000:2.0:1789597066.200320:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.200358:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984901504 00000100:00100000:2.0:1789597066.200366:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984901504 00000100:00100000:2.0:1789597066.200431:0:18557:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984901632 00000100:00100000:2.0:1789597066.200435:0:18557:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984901632 00000100:00100000:2.0:1789597066.200459:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789597066.200469:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876527984901504:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789597066.200494:0:18557:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfcfa 00000100:00080000:2.0:1789597066.200513:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c8c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789597066.200630:0:18557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789597066.200808:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1876527984901504:12345-0@lo:9:umount.0 Request processed in 339us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597066.200815:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789597066.200832:0:18557:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789597066.200839:0:18557:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876527984901632:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789597066.200851:0:18557:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfe51 00000100:00080000:2.0:1789597066.200857:0:18557:0:(import.c:65:import_set_state_nolock()) ffff9c7d84674000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789597066.200878:0:18557:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000020:00000080:1.0:1789597066.201260:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9d7d7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789597066.201321:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5584000/cded1d0b-04a6-4ab1-ac9e-f9279e87941c for lustre-MDT0000 00000020:00000080:1.0:1789597066.201361:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d84676800/7aa843d4-eae2-4ed1-be92-0aea9eabc166 for lustre-MDT0000 00000020:00000080:1.0:1789597066.201384:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb98c5000 for lustre-MDT0000 00000020:00000080:1.0:1789597066.201389:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c8b000 for lustre-MDT0000 00000020:00000080:1.0:1789597066.201392:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d84676000 for lustre-MDT0000 00010000:00010000:0.0:1789597066.201852:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597066.202571:0:18557:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3643:x1876527984901632:12345-0@lo:9:umount.0 Request processed in 1728us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597066.202580:0:18557:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789597066.202634:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebaf79800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789597066.202653:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789597066.202654:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789597066.202657:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984901504:0@lo:9:umount.0 00000100:00080000:2.0:1789597066.202665:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66aa000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789597066.202671:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789597066.202672:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789597066.202673:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984901632:0@lo:9:umount.0 00000001:00100000:3.0:1789597066.205123:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789597066.205141:0:17780:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1789597066.205146:0:17780:0:(genops.c:885:class_export_put()) final put ffff9c7eb75f1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789597066.205318:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00080000:3.0:1789597066.205326:0:17780:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1789597066.205329:0:17780:0:(genops.c:885:class_export_put()) final put ffff9c7ec1f0a800/cded1d0b-04a6-4ab1-ac9e-f9279e87941c 00000001:00100000:3.0:1789597066.205335:0:17780:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000001:00080000:3.0:1789597066.205341:0:17780:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1789597066.205343:0:17780:0:(genops.c:885:class_export_put()) final put ffff9c7d84672800/7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000100:00080000:3.0:1789597066.205466:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789597066.205471:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789597066.205481:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789597066.205751:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb75f1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1789597066.205809:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ec1f0a800/cded1d0b-04a6-4ab1-ac9e-f9279e87941c for lustre-MDT0001 00000020:00000080:0.0:1789597066.205833:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d84672800/7aa843d4-eae2-4ed1-be92-0aea9eabc166 for lustre-MDT0001 00000020:00000080:0.0:1789597066.205863:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e87565800 for lustre-MDT0001 00000020:00000080:0.0:1789597066.205868:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ec1f0a000 for lustre-MDT0001 00000020:00000080:0.0:1789597066.205872:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ec1f13000 for lustre-MDT0001 00000001:00100000:0.0:1789597066.211390:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789597066.211408:0:19371:0:(genops.c:885:class_export_put()) final put ffff9c7d84671800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789597066.211435:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000020:00000080:0.0:1789597066.211438:0:19371:0:(genops.c:885:class_export_put()) final put ffff9c7d831a2000/7aa843d4-eae2-4ed1-be92-0aea9eabc166 00000020:00000080:2.0:1789597066.211481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d84671800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789597066.211545:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d831a2000/7aa843d4-eae2-4ed1-be92-0aea9eabc166 for lustre-OST0001 00000020:00000080:2.0:1789597066.211569:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d84674000 for lustre-OST0001 00000020:00000080:2.0:1789597066.211574:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d831a1000 for lustre-OST0001 00000020:00080000:2.0:1789597066.221006:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c7d835119c0) has no exports 00000020:00000080:2.0:1789597066.332906:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa84 00000020:00000080:2.0:1789597066.332980:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7ebaf7e000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789597066.333189:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789597066.333350:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789597066.333368:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789597066.333374:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9c7d820c8000) has no exports 00000020:00000080:3.0:1789597066.333723:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa7d 00000020:00000080:3.0:1789597066.333737:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7eb9917800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789597066.338384:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebaf7e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789597066.340049:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789597066.340070:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789597066.340085:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7eb9914000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789597066.340090:0:20621:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9914000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789597066.340117:0:20621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789597066.340316:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9917800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789597066.340604:0:20621:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d821a5720 - data ffff9c7e9e463438/ffff9c7eb76adc00 00000020:01000000:3.0:1789597066.340835:0:20621:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7e84cc1840 - data ffff9c7e9e748798/ffff9c7ebbc63c00 00000001:00000004:3.0:1789597066.351888:0:20621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:0.0:1789597066.446374:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789597066.446384:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789597066.446408:0:20621:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c7d83695880 x1876527984901376/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789597076 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597066.446438:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789597066.452314:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789597066.452323:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1789597066.452346:0:20621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789597066.452349:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789597066.454113:0:17071:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789597066.454120:0:17071:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789597066.454133:0:17071:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789597066.454973:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789597066.454980:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1789597066.454998:0:20621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789597066.455000:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789597066.457302:0:17073:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789597066.457310:0:17073:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1789597066.457332:0:17073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789597066.474610:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa4c 00000020:00000080:2.0:1789597066.474624:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e9d7d2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789597066.475773:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9d7d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789597066.478477:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa61 00000020:00000080:2.0:1789597066.478494:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e83d76800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789597066.478559:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789597066.478565:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789597066.478573:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789597066.478577:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9c7d83510000) has no exports 00000004:01000000:2.0:1789597066.478820:0:20621:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789597066.478831:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfac3 00000020:00000080:2.0:1789597066.478835:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7eb98c0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789597066.486617:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e83d76800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789597066.487424:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789597066.487486:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb98c0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789597066.487513:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597066.487536:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789597066.487541:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9c7d820ccd40) has no exports 00000020:00000080:0.0:1789597066.487551:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfabc 00000020:00000080:0.0:1789597066.487562:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7eb66aa800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789597066.488630:0:20621:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789597066.488648:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789597066.488653:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1789597066.488659:0:20621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789597066.488661:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789597066.488769:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb66aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789597066.488787:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb66aa000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789597066.489014:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597066.490653:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789597066.490661:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7eb98c2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789597066.490668:0:20621:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb98c2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789597066.490751:0:20621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789597066.491316:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfaae 00000020:00000080:0.0:1789597066.491326:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7eb98c2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789597066.491403:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789597066.491408:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597066.491415:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789597066.491419:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9c7ebf993380) has no exports 00000020:00000080:0.0:1789597066.491428:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfaa7 00000020:00000080:0.0:1789597066.491432:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7ebaf7b000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789597066.494390:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb98c2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789597066.494596:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebaf7b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789597066.495463:0:20621:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789597066.495470:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789597066.495474:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1789597066.495484:0:20621:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789597066.495486:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789597066.503660:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597066.503675:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789597066.503707:0:20621:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789597066.503715:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa99 00000020:00000080:0.0:1789597066.503723:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7d83daf800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789597066.503729:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789597066.503736:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597066.503739:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789597066.503743:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff9c7e9e35cd40) has no exports 00000020:00000080:0.0:1789597066.503760:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa92 00000020:00000080:0.0:1789597066.503763:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7ebaf7f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789597066.504115:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ebaf79800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789597066.504121:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7d83daf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789597066.504123:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83daf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789597066.504130:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789597066.504209:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83daf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789597066.504212:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebaf7f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789597066.546783:0:20621:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789597066.546793:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789597066.546798:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789597066.546806:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789597066.546866:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597066.546878:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789597066.546910:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597066.546914:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789597066.546931:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e9d7d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789597066.546937:0:20621:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9d7d2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789597066.546953:0:20621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789597066.547107:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa68 00000020:00000080:2.0:1789597066.547116:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e83d71000/lustre-MDD0000_UUID 00000020:01000000:2.0:1789597066.547123:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789597066.547127:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789597066.547132:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789597066.547137:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9c7ebb18cd40) has no exports 00000020:00000080:2.0:1789597066.547158:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597066.547161:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789597066.547166:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa6f 00000020:00000080:2.0:1789597066.547169:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e83d72800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789597066.547178:0:20621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebfae6000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789597066.547181:0:20621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebfae6000 3 00000020:01000004:2.0:1789597066.547184:0:20621:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7ebfae6000 from lustre-MDT0000 00000020:00000080:2.0:1789597066.547201:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597066.547204:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789597066.547207:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e9d7d3000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789597066.547209:0:20621:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9d7d3000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789597066.547216:0:20621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789597066.547249:0:20621:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789597066.547253:0:20621:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789597066.547256:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789597066.547259:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789597066.547261:0:20621:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789597066.547267:0:20621:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9c7e85337800 f66223a4-de53-4574-9339-460f93dd2c76 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789597066.547272:0:20621:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9c7ebf994d40) has exports, disconnecting them 00000020:00080000:2.0:1789597066.547275:0:20621:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c7e85337800), last request at 1789596961 00000020:00000080:2.0:1789597066.547289:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa14 00000020:00010000:2.0:1789597066.547293:0:20621:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c7e85337800: total 2 00000100:00080000:2.0:1789597066.547297:0:20621:0:(import.c:65:import_set_state_nolock()) ffff9c7e85337000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789597066.547307:0:20621:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e85337800): rc 0 00000020:00080000:2.0:1789597066.547311:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9c7ebf994d40) has no exports 00000100:00100000:1.0:1789597066.550525:0:17040:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c7d837a5c00:17040] 1 exiting: rc = 0 00000020:00000080:1.0:1789597066.550671:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ebaf7d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789597066.550702:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7ebaf78000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789597066.550707:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebaf78000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789597066.550712:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789597066.550812:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e83d71000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789597066.550817:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7e9d7d1800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789597066.550819:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9d7d1800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789597066.550834:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789597066.550868:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e83d72800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1789597066.552061:0:17034:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c7e85337800: total 0 00010000:00010000:1.0:1789597066.552251:0:17034:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c7e85337800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789597066.552291:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742400/0x7b5398e289bbfb4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfb48 expref: 14 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552312:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81511c00/0x7b5398e289bbfdfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfdf6 expref: 13 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552322:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743400/0x7b5398e289bbfa22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfa1b expref: 12 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552332:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81511400/0x7b5398e289bbfe3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfe35 expref: 11 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552345:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a1200/0x7b5398e289bbfc9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfc98 expref: 10 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552356:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bbffcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbffc4 expref: 9 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552366:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a0800/0x7b5398e289bbfbf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfbe9 expref: 8 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552376:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e81510200/0x7b5398e289bbfb41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfb3a expref: 7 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552387:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bbffd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbffd2 expref: 6 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552424:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dba00/0x7b5398e289bbffe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbffe0 expref: 5 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552435:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bbfc75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfc6e expref: 4 pid: 17041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552446:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743000/0x7b5398e289bbfdd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfdcc expref: 3 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552456:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743e00/0x7b5398e289bbfb33 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7b5398e289bbfb2c expref: 2 pid: 17040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597066.552464:0:17034:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c7e85337800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789597066.552477:0:17034:0:(genops.c:885:class_export_put()) final put ffff9c7e85337800/f66223a4-de53-4574-9339-460f93dd2c76 00010000:00010000:1.0:1789597066.552499:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597066.552501:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597066.552503:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789597066.552550:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e85337800/f66223a4-de53-4574-9339-460f93dd2c76 for MGS 00000020:00000080:2.0:1789597066.552591:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e85337000 for MGS 00000100:00100000:3.0:1789597066.553673:0:17041:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c7e9e354200:17041] 2 exiting: rc = 0 00000100:00100000:1.0:1789597066.555301:0:17039:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c7d82315c00:17039] 0 exiting: rc = 1 00000100:00100000:2.0:1789597066.555617:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555625:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555632:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555637:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555643:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555648:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555653:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555659:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555664:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555671:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555700:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555710:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555716:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555722:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555741:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555747:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555753:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555758:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555765:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555770:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555776:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555782:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555788:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555794:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555799:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555805:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555812:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555817:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555823:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555829:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555835:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555842:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555848:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555853:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555875:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555881:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555887:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555892:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555896:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555901:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555907:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555912:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555917:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555931:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555936:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555941:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555946:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555951:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555956:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555961:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555966:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555971:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555975:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555980:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555985:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555990:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.555995:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.556000:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.556005:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.556009:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.556014:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.556295:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.556301:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597066.556307:0:20621:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1789597066.558212:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789597066.558456:0:20621:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d821a51e0 - data ffff9c7e9e4631b0/ffff9c7eb76ae800 00000020:01000000:2.0:1789597066.558601:0:20621:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7ebb2093c0 - data ffff9c7e9e5ab360/ffff9c7eb6a1e400 00000020:00000080:2.0:1789597066.559448:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbf9f8 00000020:00000080:2.0:1789597066.559461:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7d83f09800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789597066.559542:0:20621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7ebfae6000 from MGS, refs=2 00000020:01000004:2.0:1789597066.559547:0:20621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebfae6000 2 00000020:01000004:2.0:1789597066.559550:0:20621:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7ebfae6000 from MGS 00000020:00000080:2.0:1789597066.559573:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597066.559580:0:20621:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789597066.559583:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7d83f0b800/MGS 00000020:00000080:2.0:1789597066.559586:0:20621:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83f0b800/MGS for MGS 00000020:01000000:2.0:1789597066.559592:0:20621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789597066.559656:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789597066.559660:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789597066.559665:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789597066.559672:0:20621:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c7e83e41800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789597066.559697:0:20621:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9c7ebb1899c0) has exports, disconnecting them 00000020:00080000:2.0:1789597066.559702:0:20621:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c7e83e41800), last request at 1789596961 00000020:00000080:2.0:1789597066.559707:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfafb 00000020:00080000:2.0:1789597066.559715:0:20621:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e83e41800): rc 0 00000020:00000080:2.0:1789597066.559720:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e83e41800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789597066.560839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83f09800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789597066.562196:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e83e41800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789597066.562757:0:20621:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789597066.562763:0:20621:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789597066.562767:0:20621:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789597066.562774:0:20621:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789597066.562796:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83da9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789597066.562976:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789597066.562986:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789597066.563002:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7e83d75000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789597066.563005:0:20621:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e83d75000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789597066.563010:0:20621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789597066.563106:0:20621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7ebfae6000 1 00000020:00000080:1.0:1789597066.563112:0:20621:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbf9ea 00000020:00000080:1.0:1789597066.563118:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7d83f0f800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789597066.563125:0:20621:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789597066.563133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83f0f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789597066.563140:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789597066.563145:0:20621:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789597066.563149:0:20621:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9c7e9e3599c0) has no exports 00000020:00000080:1.0:1789597066.595495:0:20621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789597066.595509:0:20621:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789597066.595516:0:20621:0:(genops.c:885:class_export_put()) final put ffff9c7ebfae0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789597066.595521:0:20621:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebfae0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789597066.595596:0:20621:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789597066.595822:0:20621:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7ebfae1000 00000020:02000400:1.0:1789597066.595882:0:20621:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1789597066.685241:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789597066.685261:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984901760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597066.685333:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597066.685547:0:18559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984901760 00000100:00100000:0.0:1789597066.685555:0:18559:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984901760 00000100:00100000:0.0:1789597066.685617:0:18559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789597066.685627:0:18559:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984901760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789597066.685658:0:18559:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789597066.685742:0:18559:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984901760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597066.685750:0:18559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789597066.685808:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984901760:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789597066.685945:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597066.686066:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984902016:0@lo:400:kworker.0 00000100:00100000:2.0:1789597066.686107:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.686125:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984902528:0@lo:400:kworker.0 00000100:00100000:2.0:1789597066.686147:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.686163:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789597066.686363:0:19208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902016 00000100:00100000:0.0:1789597066.686368:0:19208:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902016 00000100:00100000:0.0:1789597066.686420:0:19208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789597066.686428:0:19208:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984902016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597066.686464:0:19208:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984902016:12345-0@lo:400:kworker.0 Request processed in 38us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597066.686469:0:19208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789597066.686488:0:18445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902528 00000100:00100000:0.0:1789597066.686491:0:18445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902528 00000100:00100000:0.0:1789597066.686516:0:18445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789597066.686520:0:18445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876527984902528:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789597066.686648:0:18445:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789597066.686697:0:18445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1876527984902528:12345-0@lo:400:kworker.0 Request processed in 156us (529us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789597066.686703:0:18445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789597066.686729:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984902272:0@lo:400:kworker.0 00000100:00100000:0.0:1789597066.686767:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597066.686788:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789597066.686793:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984901888:0@lo:400:kworker.0 00000100:00100000:0.0:1789597066.686813:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597066.686830:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984902400:0@lo:400:kworker.0 00000100:00100000:0.0:1789597066.686850:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597066.686874:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902272 00000100:00100000:0.0:1789597066.686878:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902272 00000100:00100000:0.0:1789597066.686895:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902400 00000100:00100000:0.0:1789597066.686897:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902400 00000100:00100000:0.0:1789597066.686935:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789597066.686942:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984902400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597066.686976:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984902400:12345-0@lo:400:kworker.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597066.686981:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789597066.686995:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789597066.686998:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876527984902272:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789597066.687002:0:17047:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789597066.687023:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876527984902272:12345-0@lo:400:kworker.0 Request processed in 23us (255us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789597066.687028:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789597066.687045:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984901888 00000100:00100000:0.0:1789597066.687048:0:17052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984901888 00000100:00100000:0.0:1789597066.687069:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789597066.687144:0:17052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876527984901888:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789597066.687150:0:17052:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789597066.687237:0:17052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876527984901888:12345-0@lo:400:kworker.0 Request processed in 162us (423us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789597066.687249:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789597066.687267:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789597066.687293:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789597066.687298:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c7e85f79000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789597066.687302:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789597066.687483:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984902144:0@lo:400:kworker.0 00000100:00100000:2.0:1789597066.687508:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.687598:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984902656:0@lo:400:kworker.0 00000100:00100000:2.0:1789597066.687627:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.687661:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984902016:0@lo:400:kworker.0 00000100:00080000:2.0:1789597066.687671:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789597066.687674:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789597066.687691:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789597066.687696:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597066.687700:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 590 00000100:00080000:2.0:1789597066.687709:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7d83164800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597066.687735:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb0c20000 x1876527984902784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789597066.687755:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984902528:0@lo:400:kworker.0 00000100:00100000:2.0:1789597066.687795:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984902784:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789597066.687816:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597066.687842:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902144 00000100:00100000:2.0:1789597066.687846:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902144 00000100:00100000:2.0:1789597066.687864:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902656 00000100:00100000:2.0:1789597066.687867:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902656 00000100:00100000:2.0:1789597066.687886:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902784 00000100:00100000:2.0:1789597066.687889:0:17046:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902784 00000100:00100000:2.0:1789597066.687900:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789597066.687906:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984902656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597066.687942:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984902656:12345-0@lo:400:kworker.0 Request processed in 37us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597066.687948:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789597066.687962:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789597066.687973:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876527984902144:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789597066.687978:0:17046:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789597066.688001:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1876527984902144:12345-0@lo:400:kworker.0 Request processed in 29us (493us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789597066.688006:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789597066.688017:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789597066.688020:0:17046:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984902784:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1789597066.688037:0:17046:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789597066.700668:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c7e85f79000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597066.700707:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1789597066.700724:0:3644:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c7e85f79000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597066.705601:0:3644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f08380 x1876527984902912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789597066.705641:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984901888:0@lo:400:kworker.0 00010000:00080000:0.0:1789597066.705698:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb0c22300 x1876527984902400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597066.705710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984902400:0@lo:400:kworker.0 00000100:00080000:0.0:1789597066.705724:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789597066.705730:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c7ea03c2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789597066.705733:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789597066.705739:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9c7ea03c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597066.705743:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 571 00000100:00080000:0.0:1789597066.705759:0:3644:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7ea03c2000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597066.705773:0:3644:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f08000 x1876527984903040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789597066.705804:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984902272:0@lo:400:kworker.0 00000100:00080000:1.0:1789597066.709481:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789597066.709555:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789597066.709561:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c7e90d3c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789597066.709566:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789597066.709571:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9c7e90d3c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597066.709575:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 552 00000100:00080000:1.0:1789597066.709588:0:3646:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c7e90d3c800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597066.709625:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ec1fe5180 x1876527984903168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789597066.709645:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984902144:0@lo:400:kworker.0 00010000:00080000:1.0:1789597066.709695:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb0c20e00 x1876527984902656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597066.709706:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984902656:0@lo:400:kworker.0 00000100:00100000:1.0:1789597066.735567:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984902912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789597066.735660:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597066.735721:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984903040:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789597066.735749:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597066.735769:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984903168:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789597066.735789:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597066.735832:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903040 00000100:00100000:1.0:1789597066.735840:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903040 00000100:00100000:1.0:1789597066.735873:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903168 00000100:00100000:1.0:1789597066.735876:0:17047:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903168 00000100:00100000:1.0:1789597066.735888:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789597066.735895:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984903040:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1789597066.735931:0:17047:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789597066.735972:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984903040:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 75us (221us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789597066.735979:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789597066.735996:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789597066.735999:0:17047:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984903168:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1789597066.736008:0:17047:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789597066.736040:0:17047:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984903168:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 39us (250us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789597066.736061:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1789597066.737146:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ea03c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597066.737156:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789597066.737159:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984903040:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1789597066.737181:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e90d3c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597066.737184:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789597066.737186:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984903168:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789597066.745413:0:17788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984902912 00000100:00100000:2.0:1789597066.745431:0:17788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984902912 00000100:00100000:2.0:1789597066.745484:0:17788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789597066.745495:0:17788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876527984902912:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789597066.745519:0:17788:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597066.746729:0:17788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876527984902912:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 1231us (11063us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597066.746739:0:17788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789597066.746798:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e85f79000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597066.746803:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597066.746808:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984902912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789597066.746868:0:17046:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984902784:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58845us (59050us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597066.746875:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789597066.746903:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597066.746908:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597066.746911:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984902784:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1789597067.581089:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597068.606420:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597069.629596:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597070.269049:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984903296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597070.269165:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597070.269349:0:20534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903296 00000100:00100000:1.0:1789597070.269368:0:20534:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903296 00000100:00100000:1.0:1789597070.269438:0:20534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789597070.269448:0:20534:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984903296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789597070.269481:0:20534:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789597070.269534:0:20534:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984903296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597070.269542:0:20534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789597070.269588:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984903296:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789597070.269755:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789597070.333330:0:17806:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789597070.654510:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789597071.186288:0:20822:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789597071.195459:0:20822:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789597071.195526:0:20822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.195543:0:20822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.195617:0:20822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.195623:0:20822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.196057:0:20822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789597071.196065:0:20822:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789597071.196095:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789597071.196099:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789597071.196104:0:20822:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789597071.196109:0:20822:0:(import.c:65:import_set_state_nolock()) ffff9c7e90d3c800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789597071.196128:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789597071.196129:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789597071.196131:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789597071.196982:0:20822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.196996:0:20822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.197004:0:20822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.197011:0:20822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.199567:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597071.199578:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.199593:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597071.199597:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.199607:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597071.199617:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597071.199930:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789597071.199934:0:17034:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789597071.199937:0:17034:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789597071.199986:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.199994:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597071.200033:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.200039:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1c00/0x7b5398e289bbfbe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfbf0 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.200049:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597071.200051:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.200073:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597071.200075:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.200080:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597071.200084:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597071.200087:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789597071.200088:0:17034:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1789597071.200098:0:17034:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.200101:0:17034:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597071.200114:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597071.200118:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597071.200119:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597071.200121:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597071.200141:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984903424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597071.200195:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597071.200264:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597071.200274:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984903552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597071.200300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597071.200329:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903424 00000100:00100000:2.0:1789597071.200341:0:18581:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903424 00000100:00100000:2.0:1789597071.200393:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903552 00000100:00100000:2.0:1789597071.200397:0:18581:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903552 00000100:00100000:2.0:1789597071.200423:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789597071.200433:0:18581:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876527984903424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789597071.200440:0:18581:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789597071 with bad export cookie 8886614588472949268 00010000:00010000:3.0:1789597071.203043:0:20822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597071.203057:0:20822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bbfb48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfb4f expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203076:0:20822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203082:0:20822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203087:0:20822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203091:0:20822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203114:0:20822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597071.203120:0:20822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203124:0:20822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203128:0:20822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203132:0:20822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203136:0:20822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789597071.203139:0:20822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203142:0:20822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203146:0:20822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203149:0:20822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597071.203153:0:20822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789597071.203157:0:20822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1789597071.203165:0:20822:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789597071.203200:0:20822:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789597071.203203:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789597071.203208:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789597071.203214:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789597071.203222:0:20822:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c7d84670800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789597071.203228:0:20822:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff9c7d83c8f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789597071.203232:0:20822:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9c7ebf990000) has exports, disconnecting them 00000020:00080000:3.0:1789597071.203236:0:20822:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c7d84670800), last request at 1789597066 00000020:00000080:3.0:1789597071.203242:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfe27 00000100:00080000:3.0:1789597071.203261:0:20822:0:(import.c:65:import_set_state_nolock()) ffff9c7d84675000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789597071.203301:0:20822:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d84670800): rc 0 00000020:00000080:3.0:1789597071.203304:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7d84670800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789597071.203313:0:20822:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c7d83c8f800), last request at 1789597066 00000020:00000080:3.0:1789597071.203316:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfcc9 00000100:00080000:3.0:1789597071.203321:0:20822:0:(import.c:65:import_set_state_nolock()) ffff9c7d83c8d800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789597071.203334:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d84670800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1789597071.204740:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d84675000 for lustre-MDT0001 00000020:00080000:3.0:1789597071.204769:0:20822:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d83c8f800): rc 0 00000020:00000080:3.0:1789597071.204771:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7d83c8f800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789597071.204788:0:20822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffc0dc40dabae0 00000020:00000080:3.0:1789597071.204797:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c8f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1789597071.204817:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c8d800 for lustre-MDT0001 00000100:00080000:3.0:1789597071.204836:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789597071.204839:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:1.0:1789597071.207093:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789597071.207105:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207117:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbc00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597071.207122:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207147:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597071.207154:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597071.207160:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789597071.207162:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789597071.207165:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789597071.207202:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207208:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597071.207240:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207247:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dbc00/0x7b5398e289bbfe35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfe3c expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207261:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597071.207265:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207270:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597071.207273:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207279:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597071.207294:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597071.207299:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789597071.207302:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789597071.207304:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789597071.207316:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207322:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597071.207337:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207344:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1e00/0x7b5398e289bbffe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbffe7 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207368:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597071.207372:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207378:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597071.207380:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207386:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597071.207392:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597071.207407:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789597071.207409:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789597071.207410:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789597071.207422:0:17035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207428:0:17035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597071.207434:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207439:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bbfb3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7b5398e289bbfb41 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597071.207450:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597071.207452:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597071.207453:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789597071.208434:0:20822:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789597071.208442:0:20822:0:(import.c:65:import_set_state_nolock()) ffff9c7e85f79000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1789597071.210548:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984903680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597071.210637:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597071.214111:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebfac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984903808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597071.214194:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597071.214250:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597071.214258:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebfacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984903936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597071.214286:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789597071.214419:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597071.214466:0:18581:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876527984903424:12345-0@lo:103:ldlm_bl.0 Request processed in 14033us (14270us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789597071.214476:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789597071.214519:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789597071.214523:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa98800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789597071.214527:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789597071.214544:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789597071.214551:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1789597071.214576:0:20822:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789597071.214646:0:20822:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789597071.214697:0:20822:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5584800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789597071.214714:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789597071.214716:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1789597071.214725:0:20822:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789597071.214780:0:20822:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789597071.214788:0:20822:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789597071.214825:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9c7ebf990000) has no exports 00000100:00100000:1.0:1789597071.216099:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984904064:0@lo:9:umount.0 00000100:00100000:3.0:1789597071.216769:0:17033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903680 00000100:00100000:3.0:1789597071.216797:0:17033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903680 00000100:00100000:3.0:1789597071.216816:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903808 00000100:00100000:3.0:1789597071.216818:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903808 00000100:00100000:3.0:1789597071.216843:0:17032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984903936 00000100:00100000:3.0:1789597071.216845:0:17032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984903936 00000100:00100000:3.0:1789597071.216855:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789597071.216862:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1876527984903552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789597071.216867:0:17032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789597071 with bad export cookie 8886614588472949268 00000100:00100000:0.0:1789597071.218813:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789597071.218824:0:18581:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1876527984903808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789597071.218832:0:18581:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789597071 with bad export cookie 8886614588472949268 00000100:00100000:3.0:1789597071.220219:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3647:x1876527984903552:12345-0@lo:103:ldlm_bl.0 Request processed in 3344us (19906us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789597071.220234:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789597071.221308:0:17032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789597071.221320:0:17032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876527984903936:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789597071.221329:0:17032:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789597071 with bad export cookie 8886614588472949268 00000100:00100000:3.0:1789597071.221435:0:17032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3644:x1876527984903936:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (7148us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789597071.221442:0:17032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789597071.221583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597071.222193:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984904192:0@lo:9:umount.0 00000100:00100000:1.0:1789597071.222235:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597071.222280:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984904064 00000100:00100000:1.0:1789597071.222288:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984904064 00000100:00100000:1.0:1789597071.222324:0:18554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984904192 00000100:00100000:1.0:1789597071.222327:0:18554:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984904192 00000100:00100000:1.0:1789597071.222369:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789597071.222377:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebfacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876527984904064:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789597071.222401:0:18554:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfcf3 00000100:00080000:1.0:1789597071.222412:0:18554:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e293800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789597071.222470:0:18554:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789597071.222811:0:18581:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3644:x1876527984903808:12345-0@lo:103:ldlm_bl.0 Request processed in 3985us (8617us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789597071.222820:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789597071.222881:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebfacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1876527984904064:12345-0@lo:9:umount.0 Request processed in 504us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597071.222887:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789597071.222899:0:18554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789597071.222905:0:18554:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1876527984904192:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789597071.222917:0:18554:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfe58 00000100:00080000:1.0:1789597071.222922:0:18554:0:(import.c:65:import_set_state_nolock()) ffff9c7d84677800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789597071.222950:0:18554:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1789597071.223994:0:18554:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3643:x1876527984904192:12345-0@lo:9:umount.0 Request processed in 1084us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597071.224003:0:18554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1789597071.224207:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789597071.224249:0:17042:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789597071.224260:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789597071.224475:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5584800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789597071.224529:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:2.0:1789597071.226021:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.116@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789597071.226027:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789597071.226038:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb0c20000 x1876527984903424/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789597087 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597071.226052:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb0c21880 x1876527984903552/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789597087 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597071.226063:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7ec1fe5180 x1876527984903680/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789597087 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597071.226072:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7ebfac8700 x1876527984903808/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789597087 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597071.226102:0:3645:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7ebfacb800 x1876527984903936/t0(0) o103->MGC192.168.202.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789597087 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789597071.226110:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789597071.226112:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789597071.226114:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789597071.226118:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa98800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597071.226123:0:3645:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1789597071.226137:0:3645:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff9c7ebfa98800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597071.226166:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb0c22300 x1876527984904320/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789597071.226194:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f66223a4-de53-4574-9339-460f93dd2c76:3645:1876527984903424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597071.226245:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebfacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984903936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597071.226253:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebfac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f66223a4-de53-4574-9339-460f93dd2c76:3644:1876527984903808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597071.227844:0:17033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789597071.227855:0:17033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1876527984903680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789597071.227863:0:17033:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789597071 with bad export cookie 8886614588472949268 00000100:00100000:2.0:1789597071.227959:0:17033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3647:x1876527984903680:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (17322us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789597071.227966:0:17033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1789597071.231892:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789597071.231907:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984904064:0@lo:9:umount.0 00000100:00080000:2.0:1789597071.232062:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ea000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789597071.232075:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789597071.232077:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789597071.232079:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984904192:0@lo:9:umount.0 00000100:00100000:2.0:1789597071.232106:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f66223a4-de53-4574-9339-460f93dd2c76:3643:1876527984904320:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789597071.232153:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527984904320 offset 0 length 520: 4 00000100:00100000:1.0:1789597071.232922:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984903680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597071.232936:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f66223a4-de53-4574-9339-460f93dd2c76:3647:1876527984903552:0@lo:103:ldlm_bl.0 00000001:00100000:1.0:1789597071.234616:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789597071.234625:0:18551:0:(genops.c:885:class_export_put()) final put ffff9c7e9e291800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789597071.234662:0:18551:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789597071.234664:0:18551:0:(genops.c:885:class_export_put()) final put ffff9c7d83c89800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789597071.234738:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e9e291800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789597071.234798:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83c89800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789597071.234829:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e9e293800 for lustre-OST0000 00000020:00000080:2.0:1789597071.234835:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83c8c800 for lustre-OST0000 00000020:00080000:0.0:1789597071.242761:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9c7ebf990000) has no exports 00000020:01000000:2.0:1789597071.303601:0:20822:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d821a55a0 - data ffff9c7e9e670d80/ffff9c7eb76ad400 00000020:01000000:2.0:1789597071.303821:0:20822:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d82637180 - data ffff9c7e9e665798/ffff9c7e86f4b400 00000001:00000004:0.0:1789597071.321376:0:20822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1789597071.386148:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789597071.386157:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789597071.386166:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789597071.388469:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789597071.388477:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1789597071.388502:0:20822:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789597071.388505:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789597071.393515:0:17789:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789597071.393527:0:17789:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1789597071.393549:0:17789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1789597071.397235:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789597071.397244:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1789597071.397270:0:20822:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789597071.397273:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789597071.400386:0:17791:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789597071.400395:0:17791:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789597071.400408:0:17791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1789597071.405133:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb5d 00000020:00000080:0.0:1789597071.405147:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7ebaf7e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789597071.406422:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb72 00000020:00000080:0.0:1789597071.406434:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7d837d1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789597071.406441:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1789597071.406447:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597071.406456:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789597071.406460:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9c7ebf9919c0) has no exports 00000004:01000000:0.0:1789597071.406635:0:20822:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789597071.406644:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfbc6 00000020:00000080:0.0:1789597071.406649:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7eb9a60000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789597071.406872:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebaf7e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789597071.406892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d837d1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789597071.407604:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789597071.407620:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597071.407629:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789597071.407632:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9c7d820c99c0) has no exports 00000020:00000080:0.0:1789597071.407640:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfbbf 00000020:00000080:0.0:1789597071.407646:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7e859eb000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789597071.411030:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9a60000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1789597071.411739:0:20822:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789597071.411745:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789597071.411750:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1789597071.411780:0:20822:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789597071.411783:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789597071.411820:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597071.411831:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789597071.411839:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfbb1 00000020:00000080:0.0:1789597071.411847:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7eb6636800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789597071.411853:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1789597071.411858:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597071.411862:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789597071.411865:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9c7ebb18b380) has no exports 00000020:00000080:0.0:1789597071.411872:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfbaa 00000020:00000080:0.0:1789597071.412236:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7eb6635800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1789597071.412601:0:20822:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1789597071.412605:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789597071.412821:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1789597071.412827:0:20822:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789597071.412829:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789597071.412858:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597071.412864:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1789597071.412946:0:20822:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789597071.412954:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb95 00000020:00000080:0.0:1789597071.412960:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7eb6633800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1789597071.412964:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1789597071.412968:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597071.412972:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789597071.412975:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff9c7ebb188000) has no exports 00000020:00000080:0.0:1789597071.412981:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb8e 00000020:00000080:0.0:1789597071.412984:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7e867d1000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789597071.414927:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e859eb000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789597071.414945:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e859ea000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789597071.414955:0:37:0:(genops.c:885:class_export_put()) final put ffff9c7eb6631800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789597071.414958:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6631800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789597071.414963:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789597071.415052:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6636800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789597071.415059:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6635800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789597071.415064:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7eb5584800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789597071.415069:0:37:0:(genops.c:885:class_export_put()) final put ffff9c7eb6637000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789597071.415071:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6637000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789597071.415075:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789597071.415104:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb6633800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789597071.415109:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e867d1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789597071.417085:0:20822:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789597071.417096:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789597071.417100:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789597071.417108:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789597071.417204:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789597071.417216:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789597071.417243:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789597071.417247:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789597071.417253:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7e91928000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789597071.417627:0:20822:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e91928000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789597071.417635:0:20822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789597071.418228:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb79 00000020:00000080:1.0:1789597071.418239:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7d837d0800/lustre-MDD0001_UUID 00000020:00000080:2.0:1789597071.420125:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e85f79000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789597071.420144:0:37:0:(genops.c:885:class_export_put()) final put ffff9c7eb9b58800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789597071.420148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb9b58800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789597071.420164:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789597071.421690:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789597071.422431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d837d0800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789597071.422456:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789597071.422466:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789597071.422471:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c7ebbcb3380) has no exports 00000020:00000080:2.0:1789597071.422504:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597071.422511:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789597071.422516:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7eb98c4800/lustre-MDD0001_UUID 00000020:00000080:2.0:1789597071.422518:0:20822:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb98c4800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789597071.422523:0:20822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789597071.423047:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb80 00000020:00000080:2.0:1789597071.423058:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7d837d5000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1789597071.423081:0:20822:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7d8318b800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789597071.423084:0:20822:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7d8318b800 2 00000020:01000004:2.0:1789597071.423088:0:20822:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7d8318b800 from lustre-MDT0001 00000020:00000080:2.0:1789597071.423109:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597071.423125:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789597071.423128:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7ebaf7c800/lustre-MDT0001_UUID 00000020:00000080:2.0:1789597071.423131:0:20822:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebaf7c800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789597071.423138:0:20822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1789597071.423167:0:20822:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789597071.423171:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789597071.423174:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789597071.423178:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789597071.423185:0:20822:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c7ea03c1800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789597071.423190:0:20822:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff9c7ebbcb0000) has exports, disconnecting them 00000020:00080000:2.0:1789597071.423195:0:20822:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c7ea03c1800), last request at 1789596978 00000020:00000080:2.0:1789597071.423199:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfbfe 00000020:00080000:2.0:1789597071.423210:0:20822:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7ea03c1800): rc 0 00000020:00000080:2.0:1789597071.423214:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7ea03c1800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789597071.424388:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d837d5000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789597071.424407:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ea03c1800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789597071.498770:0:20822:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789597071.498780:0:20822:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789597071.498785:0:20822:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789597071.498793:0:20822:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789597071.498832:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7e90d3c800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789597071.499018:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789597071.499027:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789597071.499032:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7ea03c4800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789597071.499036:0:20822:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ea03c4800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789597071.499047:0:20822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789597071.499109:0:20822:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7d8318b800 1 00000020:00000080:1.0:1789597071.499114:0:20822:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfb25 00000020:00000080:1.0:1789597071.499119:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7d8318a800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789597071.499128:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789597071.499135:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d8318a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789597071.499144:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789597071.499149:0:20822:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789597071.499153:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff9c7d820cb380) has no exports 00000020:00000080:0.0:1789597071.637559:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597071.637576:0:20822:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789597071.637583:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7d83188000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789597071.637589:0:20822:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83188000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789597071.637608:0:20822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789597071.637777:0:20822:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7d8318c800 00000020:01000000:0.0:1789597071.637798:0:20822:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789597071.637802:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597071.637806:0:20822:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789597071.637811:0:20822:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9c7d83513380) has no exports 00000100:00100000:2.0:1789597071.638405:0:17047:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9c7ea67f3000:17047] 1 exiting: rc = 0 00000100:00100000:2.0:1789597071.638505:0:17046:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9c7d82314600:17046] 0 exiting: rc = 1 00000100:00100000:3.0:1789597071.638602:0:17048:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9c7ea67f3e00:17048] 2 exiting: rc = 0 00000100:00100000:1.0:1789597071.640169:0:18445:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9c7e87343600:18445] 3 exiting: rc = 0 00000100:00100000:2.0:1789597071.641013:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641023:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641028:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641034:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641039:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641045:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641050:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641057:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641062:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641069:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641075:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641080:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641086:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641092:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641097:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641103:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641121:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641126:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641132:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641138:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641143:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641149:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641154:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641159:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.641164:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642204:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642214:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642221:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642226:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642233:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642238:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642244:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642249:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642253:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642258:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642263:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642268:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642272:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642277:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642282:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642287:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642293:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642298:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642304:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642309:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642314:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642321:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642326:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642332:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642338:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642343:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642374:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642379:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642385:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642392:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642397:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642403:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642429:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642437:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642443:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642449:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642455:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642461:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.642465:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597071.653440:0:17050:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c7eb466ce00:17050] 1 exiting: rc = 0 00000100:00100000:1.0:1789597071.653640:0:17049:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c7eb466d600:17049] 0 exiting: rc = 1 00000100:00100000:2.0:1789597071.654116:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654137:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654145:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654150:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654155:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654161:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654166:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654237:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654244:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654250:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654255:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654261:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654266:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654270:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654275:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654280:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654286:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654291:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654298:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654304:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654310:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654315:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654335:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654340:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654354:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654361:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654366:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654372:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654377:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654382:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654387:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654392:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654398:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654404:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654409:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654414:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654419:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654423:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654428:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654432:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654437:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654442:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654447:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654453:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654458:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654463:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654468:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654474:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654479:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654484:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654490:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654494:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654500:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654505:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654509:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654514:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654519:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654531:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654536:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654541:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654547:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654552:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654557:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.654562:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597071.655647:0:17053:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9c7eb466d400:17053] 1 exiting: rc = 0 00000100:00100000:2.0:1789597071.655853:0:17052:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9c7ea67f2000:17052] 0 exiting: rc = 1 00000100:00100000:3.0:1789597071.656378:0:17788:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9c7e872ad400:17788] 2 exiting: rc = 0 00000100:00100000:2.0:1789597071.656519:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656528:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656534:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656541:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656547:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656554:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656560:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656566:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656572:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656578:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656584:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656590:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656596:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656602:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656608:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656631:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656640:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656646:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656652:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656658:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656664:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.656670:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657101:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657113:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657118:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657247:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657254:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657293:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657300:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657306:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657313:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657319:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657325:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657332:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657338:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657344:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657361:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657368:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657374:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657397:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657405:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657411:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657418:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657425:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657431:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657436:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657442:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657449:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657455:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657462:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657470:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657491:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657497:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657503:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657510:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657516:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657521:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657527:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657533:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657539:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657545:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657550:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657564:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.657577:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.669665:0:17054:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c7eb6554800:17054] 0 exiting: rc = 1 00000100:00100000:2.0:1789597071.674398:0:17055:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c7eb6625c00:17055] 1 exiting: rc = 0 00000100:00100000:1.0:1789597071.674528:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674538:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674543:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674550:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674578:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674584:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674589:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674594:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674599:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674604:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674610:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674615:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674621:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674626:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674632:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674637:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674643:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674648:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674653:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674659:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674665:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674670:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674708:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674714:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674719:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674724:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674730:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674736:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674741:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674745:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674751:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674755:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674839:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674847:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674852:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674858:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674864:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.674869:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675012:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675024:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675030:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675035:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675040:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675045:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675050:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675056:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675060:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675065:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675069:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675074:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675079:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675083:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675088:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675093:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675098:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675102:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675107:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675112:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675117:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675133:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675138:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675143:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675148:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.675153:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597071.676143:0:17056:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c7eb6624000:17056] 0 exiting: rc = 1 00000100:00100000:1.0:1789597071.676323:0:17057:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c7eb6625800:17057] 1 exiting: rc = 0 00000100:00100000:1.0:1789597071.676398:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676405:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676411:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676417:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676423:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676427:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676433:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676438:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676444:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676464:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676470:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676476:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676482:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676487:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676493:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676499:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676505:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676510:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676517:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676522:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676528:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676533:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676539:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676544:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676549:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676555:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676561:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676566:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676571:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676576:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676581:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676587:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676593:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676598:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676604:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676610:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676616:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676622:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676628:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676634:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676640:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676645:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676650:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676655:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676668:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676674:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676730:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676737:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676742:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676748:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.676754:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677239:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677250:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677256:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677260:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677265:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677269:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677274:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677278:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677283:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677288:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677292:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677296:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.677302:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789597071.678293:0:17058:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c7eb5532000:17058] 0 exiting: rc = 1 00010000:00010000:2.0:1789597071.678589:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597071.678623:0:17059:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c7eb5533c00:17059] 1 exiting: rc = 0 00000100:00100000:1.0:1789597071.679184:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679192:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679197:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679202:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679207:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679212:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679217:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679222:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679226:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679234:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679239:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679245:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679250:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679256:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679261:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679279:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679285:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679290:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679295:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679300:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679305:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679310:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679315:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679320:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679326:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679331:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679336:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679342:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679358:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679363:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679367:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679372:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679377:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679382:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679387:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679392:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679397:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679402:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679407:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679413:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679418:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679423:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679428:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679433:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679438:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679443:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679448:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679453:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679459:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679464:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679478:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679484:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679489:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679493:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679499:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679505:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679510:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679515:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679520:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679525:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679530:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679535:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679540:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.679545:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.680387:0:17061:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9c7e96488000:17061] 1 exiting: rc = 0 00000100:00100000:1.0:1789597071.680577:0:17062:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9c7e90fcda00:17062] 2 exiting: rc = 0 00000100:00100000:3.0:1789597071.680844:0:17060:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9c7eb5532600:17060] 0 exiting: rc = 1 00000100:00100000:1.0:1789597071.681166:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681309:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681315:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681329:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681356:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681363:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681369:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681375:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681380:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681386:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681391:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681397:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681403:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681408:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681413:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681420:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681426:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681432:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681437:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681454:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681460:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681466:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681472:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681478:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681484:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681489:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681495:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681501:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681519:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681525:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681531:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681537:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681543:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681549:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681555:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681561:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681566:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681571:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681576:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681582:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681587:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681593:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681598:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681606:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681611:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681617:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681622:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681628:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681635:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681641:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681647:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681653:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681671:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681724:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681738:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681743:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681749:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681754:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681823:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681830:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681835:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681841:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681846:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597071.681852:0:20822:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789597071.691584:0:20822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597071.691598:0:20822:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789597071.691605:0:20822:0:(genops.c:885:class_export_put()) final put ffff9c7e8528a000/MDS_uuid 00000020:00000080:0.0:1789597071.691610:0:20822:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e8528a000/MDS_uuid for MDS 00000020:01000000:0.0:1789597071.691621:0:20822:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789597071.692113:0:20822:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:3.0:1789597071.814674:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597071.814736:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789597071.814740:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7ea03c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597071.814750:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 641 00000100:00080000:3.0:1789597071.814767:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789597071.814783:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7ea03c2000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597071.814822:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb458a300 x1876527984904448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597071.814891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597071.814895:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789597071.814896:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597071.814900:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 641 00000100:00080000:3.0:1789597071.814903:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789597071.814909:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7d83164800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597071.814922:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb4589f80 x1876527984904704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597071.814955:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984904832:0@lo:400:kworker.0 00000400:00000100:3.0:1789597071.815006:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984904832 offset 0 length 224: 4 00000100:00100000:3.0:1789597071.815046:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789597071.815052:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984904576:0@lo:400:kworker.0 00000400:00000100:3.0:1789597071.815069:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984904576 offset 0 length 224: 4 00000100:00100000:2.0:1789597071.815544:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984904448:0@lo:38:kworker.0 00000400:00000100:2.0:1789597071.815570:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984904448 offset 0 length 520: 4 00000100:00100000:2.0:1789597071.815586:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984904704:0@lo:38:kworker.0 00000400:00000100:2.0:1789597071.815601:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984904704 offset 0 length 520: 4 00010000:00010000:1.0:1789597072.701819:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597073.734035:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597074.750933:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597075.773044:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789597076.412334:0:21023:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789597076.425099:0:21023:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789597076.425161:0:21023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.425177:0:21023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.425185:0:21023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.425192:0:21023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.425231:0:21023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789597076.425236:0:21023:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789597076.425262:0:21023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789597076.425274:0:21023:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb458a300 x1876527984904448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789597086 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597076.425289:0:21023:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789597076.425296:0:21023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789597076.425302:0:21023:0:(import.c:65:import_set_state_nolock()) ffff9c7ea03c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789597076.425317:0:21023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789597076.425322:0:21023:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb458a300 x1876527984904448/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789597086 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597076.425328:0:21023:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789597076.425331:0:21023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00010000:00010000:3.0:1789597076.427854:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597076.427866:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.427875:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789597076.427878:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.427886:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789597076.427891:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597076.427895:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789597076.427909:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789597076.427912:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789597076.427926:0:17035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:3.0:1789597076.427929:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.427933:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031000/0x7b5398e289bbfc98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfc9f expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597076.427941:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597076.427942:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597076.427943:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597076.428913:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984904448:0@lo:38:kworker.0 00000100:00080000:3.0:1789597076.435477:0:21023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789597076.435496:0:21023:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb458b480 x1876527984904576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597087 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597076.435525:0:21023:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789597076.435532:0:21023:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789597076.435556:0:21023:0:(import.c:65:import_set_state_nolock()) ffff9c7d831a0000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789597076.436148:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984904960:0@lo:39:umount.0 00000400:00000100:0.0:1789597076.436201:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984904960 offset 0 length 224: 4 00000100:00100000:1.0:1789597076.436360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984904576:0@lo:400:kworker.0 00010000:00010000:0.0:1789597076.801240:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789597076.925049:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597076.925062:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789597076.925065:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597076.925078:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597076.925219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984905088:0@lo:400:kworker.0 00000400:00000100:1.0:1789597076.925286:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984905088 offset 0 length 224: 4 00000001:00100000:0.0:1789597076.942101:0:19371:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789597076.942109:0:19371:0:(genops.c:885:class_export_put()) final put ffff9c7d84675800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789597076.942187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d84675800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789597076.942241:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d84677800 for lustre-OST0001 00010000:00010000:3.0:1789597077.824384:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597078.847928:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597079.869306:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597080.896382:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597081.533750:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597071/real 1789597071] req@ffff9c7eb0c22300 x1876527984904320/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789597081 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597081.533790:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb0c22300 x1876527984904320/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789597081 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789597081.533811:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa98800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597081.533836:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789597081.533840:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f66223a4-de53-4574-9339-460f93dd2c76:3643:1876527984904320:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1789597081.533876:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597081.533901:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789597081.533904:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa98800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597081.533909:0:479:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 646 00000100:00080000:3.0:1789597081.533915:0:479:0:(import.c:630:import_select_connection()) MGC192.168.202.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789597081.533925:0:479:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff9c7ebfa98800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597081.533955:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb458aa00 x1876527984905216/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597081.533983:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597081.533987:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597081.534134:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984905344:0@lo:400:kworker.0 00000400:00000100:1.0:1789597081.534186:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984905344 offset 0 length 224: 4 00000100:00100000:2.0:1789597081.534487:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f66223a4-de53-4574-9339-460f93dd2c76:3643:1876527984905216:0@lo:250:kworker.0 00000400:00000100:2.0:1789597081.534509:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527984905216 offset 0 length 520: 4 00010000:00010000:3.0:1789597081.917311:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597082.943854:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597083.965054:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597084.989166:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597086.013519:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789597086.653037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789597086.653048:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789597086.653051:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789597086.653053:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789597086.653160:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984905472:0@lo:400:kworker.0 00000400:00000100:2.0:1789597086.653248:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984905472 offset 0 length 224: 4 00000100:00100000:3.0:1789597086.654373:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597076/real 1789597076] req@ffff9c7eb4588000 x1876527984904960/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789597086 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597086.654402:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb4588000 x1876527984904960/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789597086 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597086.654412:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597071/real 1789597071] req@ffff9c7eb4589f80 x1876527984904704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789597086 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597086.654429:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb4589f80 x1876527984904704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789597086 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789597086.654446:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d831a0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789597086.654470:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984904960:0@lo:39:umount.0 00000100:00080000:3.0:1789597086.654477:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597086.654498:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789597086.654516:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984904704:0@lo:38:kworker.0 00000100:00080000:3.0:1789597086.654565:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597086.654569:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789597086.654572:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789597086.654576:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789597086.654578:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597086.654583:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 646 00000100:00080000:3.0:1789597086.654589:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789597086.654601:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7d83164800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597086.654628:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb4589f80 x1876527984905600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597086.654661:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984905600:0@lo:38:kworker.0 00000400:00000100:3.0:1789597086.654730:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984905600 offset 0 length 520: 4 00000100:00080000:2.0:1789597086.654882:0:21023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789597086.654899:0:21023:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789597086.654905:0:21023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789597086.655859:0:21023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655886:0:21023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655894:0:21023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655901:0:21023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655923:0:21023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597086.655931:0:21023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655937:0:21023:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655943:0:21023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655950:0:21023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597086.655978:0:21023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789597086.655982:0:21023:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789597086.656014:0:21023:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789597086.656019:0:21023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789597086.656024:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789597086.656031:0:21023:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789597086.656036:0:21023:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9c7e9e35b380) has no exports 00000020:00080000:2.0:1789597086.656059:0:21023:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9c7e9e35b380) has no exports 00000020:01000000:2.0:1789597086.657931:0:21023:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d821a52a0 - data ffff9c7d81c20288/ffff9c7eb76ac800 00000020:01000000:2.0:1789597086.658087:0:21023:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7eb64a9ba0 - data ffff9c7e9e416798/ffff9c7e872ba400 00010000:00010000:3.0:1789597086.658592:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789597086.658603:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658614:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789597086.658618:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658628:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789597086.658636:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597086.658660:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789597086.658662:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789597086.658665:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789597086.658703:0:17035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:3.0:1789597086.658708:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658714:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bbfc6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfc75 expref: -99 pid: 18550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658727:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597086.658730:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658736:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789597086.658739:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658746:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789597086.658753:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597086.658758:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789597086.658760:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789597086.658762:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789597086.658767:0:17035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:3.0:1789597086.658770:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658783:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80030000/0x7b5398e289bbffd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbffd9 expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597086.658792:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597086.658794:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597086.658796:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597086.658873:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789597086.669328:0:21023:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789597086.685878:0:21023:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfc83 00000020:00000080:0.0:1789597086.685893:0:21023:0:(genops.c:885:class_export_put()) final put ffff9c7d83ee1800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789597086.685906:0:21023:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7eb75f4800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789597086.685909:0:21023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7eb75f4800 2 00000020:01000004:0.0:1789597086.685925:0:21023:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7eb75f4800 from lustre-OST0000 00000020:00000080:0.0:1789597086.685951:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597086.685963:0:21023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789597086.685967:0:21023:0:(genops.c:885:class_export_put()) final put ffff9c7d83ee0800/lustre-OST0000_UUID 00000020:00000080:0.0:1789597086.685970:0:21023:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83ee0800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789597086.685977:0:21023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789597086.686026:0:21023:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789597086.686030:0:21023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789597086.686034:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597086.686040:0:21023:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789597086.686047:0:21023:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c7e90d3e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789597086.686053:0:21023:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff9c7ebbcb19c0) has exports, disconnecting them 00000020:00080000:0.0:1789597086.686058:0:21023:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c7e90d3e000), last request at 1789596996 00000020:00000080:0.0:1789597086.686062:0:21023:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfcad 00000020:00080000:0.0:1789597086.686072:0:21023:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7e90d3e000): rc 0 00000020:00000080:0.0:1789597086.686077:0:21023:0:(genops.c:885:class_export_put()) final put ffff9c7e90d3e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789597086.687100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83ee1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789597086.687124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e90d3e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789597086.687924:0:21023:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789597086.687931:0:21023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789597086.687936:0:21023:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789597086.687942:0:21023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789597086.688107:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789597086.688115:0:21023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789597086.688122:0:21023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789597086.688127:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789597086.688132:0:21023:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789597086.688140:0:21023:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c7d831a0800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789597086.688146:0:21023:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff9c7ebbcb4d40) has exports, disconnecting them 00000020:00080000:1.0:1789597086.688150:0:21023:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c7d831a0800), last request at 1789596996 00000020:00000080:1.0:1789597086.688170:0:21023:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfcc2 00000020:00080000:1.0:1789597086.688187:0:21023:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d831a0800): rc 0 00000020:00000080:1.0:1789597086.688193:0:21023:0:(genops.c:885:class_export_put()) final put ffff9c7d831a0800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789597086.688548:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ea03c2000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789597086.688557:0:36:0:(genops.c:885:class_export_put()) final put ffff9c7eb5583800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789597086.688559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb5583800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789597086.688565:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789597086.688626:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d831a0800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789597086.706858:0:21023:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789597086.706866:0:21023:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789597086.706874:0:21023:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789597086.706881:0:21023:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789597086.706925:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d831a0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789597086.707130:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789597086.707140:0:21023:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789597086.707147:0:21023:0:(genops.c:885:class_export_put()) final put ffff9c7e90d3b000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789597086.707151:0:21023:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e90d3b000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789597086.707158:0:21023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789597086.707237:0:21023:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7eb75f4800 1 00000020:00000080:3.0:1789597086.707243:0:21023:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfc60 00000020:00000080:3.0:1789597086.707250:0:21023:0:(genops.c:885:class_export_put()) final put ffff9c7e87605000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789597086.707270:0:21023:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789597086.707278:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e87605000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789597086.707287:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789597086.707302:0:21023:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789597086.707313:0:21023:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff9c7eb98bcd40) has no exports 00000020:00000080:2.0:1789597086.851606:0:21023:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789597086.851621:0:21023:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789597086.851627:0:21023:0:(genops.c:885:class_export_put()) final put ffff9c7eb75f3000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789597086.851631:0:21023:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7eb75f3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789597086.851643:0:21023:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789597086.851773:0:21023:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7eb75f2800 00000020:02000400:2.0:1789597086.851843:0:21023:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789597087.036920:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789597087.153107:0:3647:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597071/real 1789597071] req@ffff9c7eb4588380 x1876527984904832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789597087 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597087.200918:0:3647:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9c7eb4588380 x1876527984904832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789597087 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789597087.200933:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f21800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789597087.200937:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789597087.227147:0:3647:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1789597087.227186:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789597087.227192:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597087.227194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789597087.227215:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597087.227218:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789597087.227220:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789597087.227225:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f21800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597087.227233:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 590 00000100:00080000:1.0:1789597087.227249:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c7d83f21800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597087.227285:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb026680 x1876527984905728/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789597087.229271:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984905728:0@lo:38:kworker.0 00000400:00000100:1.0:1789597087.231002:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527984905728 offset 0 length 520: 4 00000100:00100000:1.0:1789597087.231118:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984904832:0@lo:400:kworker.0 00010000:00010000:3.0:1789597088.064837:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597089.090082:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597090.109862:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597091.134993:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789597091.265988:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789597091.265998:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597091.266001:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789597091.266005:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597091.266008:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789597091.266012:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789597091.774990:0:21227:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789597091.798928:0:21227:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789597091.799038:0:21227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.799054:0:21227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.799062:0:21227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.799069:0:21227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.799094:0:21227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789597091.799100:0:21227:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789597091.799122:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789597091.799134:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb4589f80 x1876527984905600/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789597106 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597091.799170:0:21227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789597091.799215:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597091.799228:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789597091.799233:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984905600:0@lo:38:kworker.0 00000100:00080000:1.0:1789597091.799258:0:21227:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789597091.799263:0:21227:0:(import.c:65:import_set_state_nolock()) ffff9c7d83164800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789597091.799267:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789597091.799269:0:21227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789597091.799273:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789597091.800088:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789597091.800099:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb458a680 x1876527984905088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597092 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597091.800120:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb4589c00 x1876527984905344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597097 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597091.800133:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb0c22300 x1876527984905472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597102 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597091.800145:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7ebb026680 x1876527984905728/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789597097 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597091.800154:0:21227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789597091.800193:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876527984905344:0@lo:400:kworker.0 00000100:00080000:1.0:1789597091.800220:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f21800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597091.800223:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789597091.800226:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984905728:0@lo:38:kworker.0 00000100:00080000:1.0:1789597091.800242:0:21227:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789597091.800245:0:21227:0:(import.c:65:import_set_state_nolock()) ffff9c7d83f21800 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789597091.800249:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789597091.800262:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb458a680 x1876527984905088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597092 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597091.800270:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb0c22300 x1876527984905472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597102 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597091.800275:0:21227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789597091.800278:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:2.0:1789597091.800879:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597091.800889:0:17034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.800900:0:17034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597091.800904:0:17034:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.800914:0:17034:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597091.800930:0:17034:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597091.800947:0:17034:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789597091.800949:0:17034:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789597091.800952:0:17034:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789597091.800968:0:17034:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:2.0:1789597091.800972:0:17034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.803654:0:17034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0200/0x7b5398e289bbfdf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfdfd expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.803694:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597091.803696:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597091.803699:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789597091.803722:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789597091.803727:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) f66223a4-de53-4574-9339-460f93dd2c76->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789597091.803770:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984905088:0@lo:400:kworker.0 00000100:00100000:2.0:1789597091.803824:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984905472:0@lo:400:kworker.0 00010000:00010000:1.0:1789597091.806449:0:21227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806473:0:21227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806481:0:21227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806487:0:21227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806516:0:21227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597091.806523:0:21227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806530:0:21227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806535:0:21227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806541:0:21227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597091.806575:0:21227:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789597091.806580:0:21227:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789597091.806613:0:21227:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789597091.806617:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789597091.806622:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789597091.806628:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789597091.806634:0:21227:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9c7eb557cd40) has no exports 00000020:00080000:1.0:1789597091.806656:0:21227:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9c7eb557cd40) has no exports 00010000:00010000:2.0:1789597091.808411:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597091.808425:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808437:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e81511a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597091.808441:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808468:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597091.808477:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597091.808483:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789597091.808486:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789597091.808488:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789597091.808503:0:17035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:2.0:1789597091.808508:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808515:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e81511a00/0x7b5398e289bbfdcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfdd3 expref: -99 pid: 19370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808530:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597091.808534:0:17035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808540:0:17035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031e00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597091.808543:0:17035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808549:0:17035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597091.808555:0:17035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597091.808571:0:17035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789597091.808573:0:17035:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789597091.808575:0:17035:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789597091.808582:0:17035:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:2.0:1789597091.808585:0:17035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808591:0:17035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031e00/0x7b5398e289bbffc4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbffcb expref: -99 pid: 17043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597091.808605:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597091.808606:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597091.808608:0:17035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597091.808615:0:17034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789597091.812433:0:21227:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7e9921c960 - data ffff9c7e9e5520d8/ffff9c7d8317ac00 00000020:01000000:1.0:1789597091.812608:0:21227:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7d821a53c0 - data ffff9c7e9e665510/ffff9c7e87582800 00100000:10000000:0.0:1789597091.825808:0:21227:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789597091.835902:0:21227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfde1 00000020:00000080:0.0:1789597091.835916:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7d83165800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789597091.835927:0:21227:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7e875ed800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789597091.835930:0:21227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e875ed800 2 00000020:01000004:0.0:1789597091.835933:0:21227:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7e875ed800 from lustre-OST0001 00000020:00000080:0.0:1789597091.835973:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597091.835984:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789597091.835987:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7d83161800/lustre-OST0001_UUID 00000020:00000080:0.0:1789597091.835990:0:21227:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83161800/lustre-OST0001_UUID for lustre-OST0001 00000020:00000080:2.0:1789597091.836186:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83165800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789597091.836293:0:21227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789597091.836381:0:21227:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f66223a4-de53-4574-9339-460f93dd2c76->MGS 00010000:00010000:0.0:1789597091.836406:0:21227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfb33 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789597091.836418:0:21227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfb33 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789597091.836424:0:21227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789597091.836427:0:21227:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789597091.836430:0:21227:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789597091.836442:0:21227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:0.0:1789597091.836446:0:21227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0c00/0x7b5398e289bbfb2c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfb33 expref: -99 pid: 17779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597091.836459:0:21227:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789597091.836466:0:21227:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789597091.836470:0:21227:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789597091.836472:0:21227:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789597091.836474:0:21227:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789597091.836482:0:21227:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c7ebfa98800 00010000:00010000:0.0:1789597091.836485:0:21227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7ec2052600/0x7b5398e289bbfa1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7b5398e289bbfa22 expref: -99 pid: 17025 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789597091.836500:0:21227:0:(import.c:65:import_set_state_nolock()) ffff9c7ebfa98800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789597091.836504:0:21227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789597091.836506:0:21227:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789597091.836508:0:21227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789597091.836512:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789597091.836522:0:21227:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7eb458aa00 x1876527984905216/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789597096 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789597091.836555:0:21227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789597091.836558:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:2.0:1789597091.837184:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f66223a4-de53-4574-9339-460f93dd2c76:3643:1876527984905216:0@lo:250:kworker.0 10000000:01000000:0.0:1789597091.837572:0:21227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789597091.837585:0:21227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfa06 00000020:00000080:0.0:1789597091.837592:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7ebfa9d800/f66223a4-de53-4574-9339-460f93dd2c76 00000020:01000000:0.0:1789597091.837635:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.116@tcp (flags='') 00000020:00000080:0.0:1789597091.837767:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597091.837774:0:21227:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.116@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789597091.837779:0:21227:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9c7d83514d40) has no exports 00000020:00000080:2.0:1789597091.837950:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebfa9d800/f66223a4-de53-4574-9339-460f93dd2c76 for MGC192.168.202.116@tcp 10000000:01000000:1.0:1789597091.838524:0:17043:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789597091.838871:0:21227:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.116@tcp: client import never connected 00000100:00080000:0.0:1789597091.838876:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789597091.838879:0:21227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789597091.838882:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789597091.838884:0:21227:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789597091.838975:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597091.838984:0:21227:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.116@tcp (uuid f66223a4-de53-4574-9339-460f93dd2c76) 00000020:01000000:0.0:1789597091.839002:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789597091.839009:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597091.839014:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789597091.839022:0:21227:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c7d84672000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789597091.839027:0:21227:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9c7eb557b380) has exports, disconnecting them 00000020:00080000:0.0:1789597091.839031:0:21227:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c7d84672000), last request at 1789597015 00000020:00000080:0.0:1789597091.839036:0:21227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfe0b 00000020:00080000:0.0:1789597091.839050:0:21227:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d84672000): rc 0 00000020:00000080:0.0:1789597091.839055:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7d84672000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789597091.839440:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7ebfa98800 for MGC192.168.202.116@tcp 00000020:00000080:2.0:1789597091.839449:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7ebfa9c800/f66223a4-de53-4574-9339-460f93dd2c76 00000020:00000080:2.0:1789597091.839452:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7ebfa9c800/f66223a4-de53-4574-9339-460f93dd2c76 for MGC192.168.202.116@tcp 00000020:01000000:2.0:1789597091.839458:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.116@tcp (f66223a4-de53-4574-9339-460f93dd2c76) 00000020:00000080:2.0:1789597091.841632:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d84672000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789597091.858402:0:21227:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789597091.858411:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789597091.858415:0:21227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789597091.858423:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789597091.858924:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597091.858949:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789597091.858956:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789597091.858962:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597091.858966:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789597091.858974:0:21227:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c7d83f24800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789597091.858981:0:21227:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff9c7eb76cb380) has exports, disconnecting them 00000020:00080000:0.0:1789597091.858985:0:21227:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c7d83f24800), last request at 1789597015 00000020:00000080:0.0:1789597091.858990:0:21227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfe20 00000020:00080000:0.0:1789597091.859073:0:21227:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7d83f24800): rc 0 00000020:00000080:0.0:1789597091.859077:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7d83f24800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1789597091.859118:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83164800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789597091.859126:0:479:0:(genops.c:885:class_export_put()) final put ffff9c7d83167000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789597091.859129:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83167000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789597091.859151:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789597091.869059:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83f24800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1789597091.871913:0:21227:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789597091.871921:0:21227:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789597091.871925:0:21227:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789597091.871931:0:21227:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789597091.872237:0:479:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c7d83f21800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789597091.883271:0:17035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789597091.891821:0:17034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1789597091.892223:0:17029:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c7e82405a00:17029] 0 exiting: rc = 1 00000100:00100000:3.0:1789597091.893896:0:17030:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c7e83bdb000:17030] 1 exiting: rc = 0 00000100:00100000:0.0:1789597091.894173:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.894626:0:17032:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c7e83bda200:17032] 1 exiting: rc = 0 00000100:00100000:3.0:1789597091.894899:0:18581:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c7d833cd000:18581] 3 exiting: rc = 0 00000100:00100000:3.0:1789597091.894986:0:17031:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c7e83bdb200:17031] 0 exiting: rc = 1 00000100:00100000:3.0:1789597091.924309:0:17033:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c7ebaf73600:17033] 2 exiting: rc = 0 00000100:00100000:0.0:1789597091.924491:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924502:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924508:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924515:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924521:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924530:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924540:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924546:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924551:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924557:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924564:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924570:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924576:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924581:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924586:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924591:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924596:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924617:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924623:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924629:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924634:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924640:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924645:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924650:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924657:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924664:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924670:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924674:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924715:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924720:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924725:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924730:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924734:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924739:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924743:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924747:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924753:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924758:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924763:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924768:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924773:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924778:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924783:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924788:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924799:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924805:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924810:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924816:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924822:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924827:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924832:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924837:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924851:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924856:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924861:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924867:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924871:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924877:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924882:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924887:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924892:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924898:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924903:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789597091.924907:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789597091.929018:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597091.929030:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789597091.929035:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7d83f22000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789597091.929040:0:21227:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7d83f22000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789597091.929051:0:21227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789597091.929109:0:21227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e875ed800 1 00000020:00000080:0.0:1789597091.929115:0:21227:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7b5398e289bbfdc5 00000020:00000080:0.0:1789597091.929122:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7e875ea800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789597091.929138:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789597091.929152:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e875ea800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789597091.929174:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597091.929178:0:21227:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789597091.929182:0:21227:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9c7e9e358000) has no exports 00000020:00000080:0.0:1789597092.107430:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597092.107444:0:21227:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789597092.107450:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7e875ef800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789597092.107455:0:21227:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e875ef800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789597092.107461:0:21227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789597092.107846:0:21227:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7e875ee000 00000020:01000000:0.0:1789597092.107880:0:21227:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789597092.107896:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789597092.107901:0:21227:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789597092.107906:0:21227:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9c7eb76ccd40) has no exports 00000020:00000080:0.0:1789597092.107945:0:21227:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789597092.107951:0:21227:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789597092.107955:0:21227:0:(genops.c:885:class_export_put()) final put ffff9c7e87605800/OSS_uuid 00000020:00000080:0.0:1789597092.107958:0:21227:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7e87605800/OSS_uuid for OSS 00000020:01000000:0.0:1789597092.107962:0:21227:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789597092.108054:0:18554:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9c7e8746d400:18554] 0 exiting: rc = 1 00000100:00100000:3.0:1789597092.108385:0:18556:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9c7d82646400:18556] 1 exiting: rc = 0 00000100:00080000:1.0:1789597092.108596:0:17042:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789597092.108872:0:19208:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9c7d83faf600:19208] 3 exiting: rc = 0 00000100:00100000:2.0:1789597092.108937:0:18557:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9c7d82647a00:18557] 2 exiting: rc = 0 00000100:00100000:1.0:1789597092.109087:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109095:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109101:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109106:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109111:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109117:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109122:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109127:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109133:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109150:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109155:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109170:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109175:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109180:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109185:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109191:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109204:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109211:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109216:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109220:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109236:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109241:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109246:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109252:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109257:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109262:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109267:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109272:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109277:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109281:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109287:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109291:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109296:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109302:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109308:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109315:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109320:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109326:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109330:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109336:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109341:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109347:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109352:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109359:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109364:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109368:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109374:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109378:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109384:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109390:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109396:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109400:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109405:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109410:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109414:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109427:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109432:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109437:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109442:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109447:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109451:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109457:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109462:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.109467:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789597092.111617:0:18559:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c7eb0e71a00:18559] 1 exiting: rc = 0 00000100:00100000:3.0:1789597092.111828:0:18558:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c7d82647400:18558] 0 exiting: rc = 1 00000100:00100000:2.0:1789597092.114857:0:20534:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c7d844baa00:20534] 2 exiting: rc = 0 00000100:00100000:1.0:1789597092.115092:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115102:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115108:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115112:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115118:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115123:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115128:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115133:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115148:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115155:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115170:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115176:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115181:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115186:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115191:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115196:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115201:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115207:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115211:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115216:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115221:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115227:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115232:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115237:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115242:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115247:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115268:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115273:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115278:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115282:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115287:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115292:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115298:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115304:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115309:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115314:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115321:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115326:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115331:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115336:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115341:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115346:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115352:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115357:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115362:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115368:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115374:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115379:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115385:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115390:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115395:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115400:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115404:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115410:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115415:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115420:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115425:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115430:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115435:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115440:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115445:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115457:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115462:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.115467:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.117098:0:18561:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c7e8597b000:18561] 1 exiting: rc = 0 00000100:00100000:0.0:1789597092.117510:0:18562:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c7e8597a200:18562] 2 exiting: rc = 0 00000100:00100000:2.0:1789597092.117904:0:18560:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c7e8597a000:18560] 0 exiting: rc = 1 00000100:00100000:1.0:1789597092.117997:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118004:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118010:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118016:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118021:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118026:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118033:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118038:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118046:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118052:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118058:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118063:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118070:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118076:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118082:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118088:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118094:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118099:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118105:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118111:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118116:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118122:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118129:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118231:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118239:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118245:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118251:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118257:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118262:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118267:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118273:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118279:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118297:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118303:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118309:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118314:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118319:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118325:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118330:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118336:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118342:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118347:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118351:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118356:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118361:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118366:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118371:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118388:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118395:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118400:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118406:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118414:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118420:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118425:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118433:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118440:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118446:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118452:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118458:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118465:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118471:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118476:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118483:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789597092.118488:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.132296:0:18564:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c7eb98b3400:18564] 1 exiting: rc = 0 00000100:00100000:1.0:1789597092.134669:0:18563:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c7e9939f400:18563] 0 exiting: rc = 1 00000100:00100000:2.0:1789597092.134988:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.134999:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135004:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135009:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135014:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135019:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135032:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135038:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135042:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135047:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135053:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135058:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135063:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135069:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135074:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135079:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135084:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135089:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135094:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135098:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135103:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135109:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135113:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135119:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135124:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135128:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135154:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135168:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135174:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135180:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135185:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135189:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135194:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135199:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135203:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135208:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135213:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135218:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135223:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135229:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135233:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135243:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135249:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135255:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135260:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135266:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135271:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135277:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135282:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135286:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135291:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135296:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135302:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135307:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135312:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135317:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135322:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135331:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135337:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135342:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135348:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135361:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135368:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.135379:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.136408:0:18566:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c7d83773200:18566] 1 exiting: rc = 0 00000100:00100000:1.0:1789597092.136858:0:18565:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c7d83772200:18565] 0 exiting: rc = 1 00000100:00100000:2.0:1789597092.136966:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137049:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137061:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137067:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137072:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137078:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137083:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137089:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137094:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137099:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137106:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137133:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137220:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137229:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137236:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137243:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137249:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137254:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137259:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137265:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137271:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137276:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137281:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137299:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137304:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137309:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137314:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137319:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137324:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137329:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137335:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137355:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137361:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137367:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137373:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137393:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137400:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137405:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137410:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137416:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137421:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137426:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137431:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137437:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137443:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137448:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137454:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137474:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137481:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137486:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137492:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137498:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137504:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137510:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137516:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137525:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137531:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137537:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137543:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137566:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137574:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137580:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137586:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789597092.137600:0:21227:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789597092.169466:0:21227:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789597117.774258:0:21992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789597130.837389:0:22592:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789597130.837396:0:22592:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789597130.837398:0:22592:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789597130.837627:0:22592:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7d83162800 00000020:01000004:3.0:1789597130.837643:0:22592:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789597130.837651:0:22592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789597130.837665:0:22592:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c7eb76c8000) 00000020:00000080:3.0:1789597130.837708:0:22592:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789597130.895432:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789597130.897190:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789597130.899635:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.901613:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.902145:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.902382:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.902620:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.902907:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.903276:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.903917:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.904249:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.904527:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.904916:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.905315:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.905664:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.906560:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.906904:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.907166:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.907321:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.907581:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.908121:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.908292:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.908585:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.908933:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.909313:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.909624:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.910197:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.910523:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.910734:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.911183:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.911389:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.911621:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.912173:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.912404:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789597130.912702:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789597130.914632:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789597130.915715:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.916198:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789597130.916411:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789597130.916722:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.917187:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.917433:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.917748:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789597130.918301:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.918638:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789597130.919203:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.919578:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789597130.921631:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.922314:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789597130.922600:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789597130.923546:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789597130.923784:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789597130.924261:0:22592:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1789597130.925440:0:22592:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789597130.926113:0:22592:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789597130.926122:0:22592:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789597130.926132:0:22592:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc0279 00000020:01000004:3.0:1789597130.926139:0:22592:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789597130.926143:0:22592:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789597130.926149:0:22592:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7d83162800 from MGS 00000020:01000004:3.0:1789597130.926152:0:22592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789597130.926162:0:22592:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c7eb76c99c0) 00000020:00000080:3.0:1789597130.926172:0:22592:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789597130.926233:0:22592:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d83162800 from MGS, refs=2 00080000:01000000:3.0:1789597130.926238:0:22592:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789597130.926243:0:22592:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc0287 00000100:00100000:3.0:1789597130.926355:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789597130.926507:0:22592:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789597130.926514:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789597130.927453:0:22592:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789597130.927593:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789597130.928669:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789597130.929275:0:22592:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789597130.929281:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789597130.930298:0:22592:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789597130.930307:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789597130.931315:0:22592:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789597130.931325:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789597130.932427:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597130.932432:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597130.932434:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597130.933167:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597130.933170:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597130.933172:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597130.933932:0:22592:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789597130.936099:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789597130.942135:0:22592:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789597130.944761:0:22604:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789597130.944837:0:22592:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789597130.944893:0:22592:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789597130.949238:0:22592:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789597130.950231:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789597130.950408:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789597130.950415:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789597130.958652:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789597130.958669:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789597130.959951:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789597130.959971:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789597130.961252:0:22592:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789597130.961275:0:22592:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.116@tcp' 00000020:01000004:1.0:1789597130.961278:0:22592:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789597130.961308:0:22592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.116@tcp (typ=mgc) 00000020:00000080:1.0:1789597130.961321:0:22592:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.116@tcp (ffff9c7ebbcb0000) 00000020:00000080:1.0:1789597130.961408:0:22592:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789597130.961565:0:22592:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d84e21000@MGC192.168.202.116@tcp: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789597130.961755:0:22592:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.116@tcp-0 is initialized 00000040:01000000:1.0:1789597130.961762:0:22592:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789597130.962605:0:22609:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789597130.966619:0:22610:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789597130.970422:0:22592:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.116@tcp (uuid 980ee822-f655-4df0-a283-f316bd6c264b) 00000020:00000080:3.0:1789597130.970456:0:22592:0:(genops.c:1384:class_connect()) connect: client 980ee822-f655-4df0-a283-f316bd6c264b, cookie 0x7b5398e289bc0295 00000100:00080000:3.0:1789597130.970598:0:22592:0:(import.c:545:import_select_connection()) MGC192.168.202.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789597130.970613:0:22592:0:(import.c:666:import_select_connection()) MGC192.168.202.116@tcp: import ffff9c7d84e21000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597130.970657:0:22592:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb4588000 x1876527984905856/t0(0) o250->MGC192.168.202.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597130.970722:0:22592:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 980ee822-f655-4df0-a283-f316bd6c264b->MGS 00000020:01000004:3.0:1789597130.970747:0:22592:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789597130.970753:0:22592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789597130.970771:0:22592:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c7eb76ccd40) 00000020:00000080:3.0:1789597130.970785:0:22592:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789597130.970961:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:980ee822-f655-4df0-a283-f316bd6c264b:3643:1876527984905856:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789597130.971042:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597130.971102:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984905856 00000100:00100000:0.0:1789597130.971112:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984905856 00000100:00100000:0.0:1789597130.971151:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789597130.971159:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876527984905856:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789597130.971181:0:22606:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 980ee822-f655-4df0-a283-f316bd6c264b@0@lo t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:0.0:1789597130.971212:0:22606:0:(genops.c:1384:class_connect()) connect: client 980ee822-f655-4df0-a283-f316bd6c264b, cookie 0x7b5398e289bc02a3 00000100:00080000:0.0:1789597130.971355:0:22606:0:(import.c:65:import_set_state_nolock()) ffff9c7ec1f17800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597130.971410:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+5:3643:x1876527984905856:12345-0@lo:250:mount.lustre.0 Request processed in 250us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597130.971418:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789597130.971712:0:3643:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789597130.971722:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.116@tcp: connect to target with instance 0 00000100:00080000:1.0:1789597130.971730:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789597130.971735:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789597130.971738:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d84e21000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789597130.971740:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789597130.971753:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789597130.971757:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:980ee822-f655-4df0-a283-f316bd6c264b:3643:1876527984905856:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789597130.986217:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789597130.986607:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789597130.986614:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789597130.991292:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789597130.991309:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789597130.992136:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789597130.992145:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789597130.992985:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789597130.993231:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789597130.993236:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789597130.994586:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789597130.994596:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789597131.036539:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789597131.036903:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789597131.036911:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789597131.038611:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789597131.038624:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789597131.039541:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789597131.039837:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789597131.039845:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789597131.040388:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789597131.040395:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789597131.041272:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789597131.041426:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789597131.041431:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789597131.042098:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789597131.042105:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789597131.043627:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789597131.047561:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789597131.047574:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789597131.049179:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789597131.049190:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789597131.090449:0:22592:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789597131.090715:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789597131.090722:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789597131.094264:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789597131.094282:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789597131.096456:0:22592:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789597131.096925:0:22592:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789597131.106325:0:22592:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789597131.106451:0:22592:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789597131.106524:0:22592:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789597131.106764:0:22592:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789597131.106798:0:22592:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789597131.106815:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789597131.106817:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789597131.106818:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597131.106820:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597131.106821:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597131.106822:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597131.106823:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789597131.106825:0:22592:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789597131.106827:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597131.106828:0:22592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789597131.106831:0:22592:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789597131.106832:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789597131.106834:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789597131.106835:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597131.106836:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597131.106836:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597131.106838:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597131.106838:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789597131.106839:0:22592:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789597131.106840:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597131.106841:0:22592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789597131.106878:0:22592:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789597131.106898:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984905984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789597131.107072:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.107153:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789597131.107192:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984905984 00000100:00100000:0.0:1789597131.107200:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984905984 00000100:00100000:0.0:1789597131.107280:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597131.107290:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+5:22592:x1876527984905984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789597131.107331:0:22608:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789597131.107333:0:22608:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789597131.107336:0:22608:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789597131.107650:0:22629:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789597131.114307:0:22608:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1789597131.119190:0:22630:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789597131.119199:0:22630:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789597131.119203:0:22630:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789597131.119206:0:22630:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789597131.119528:0:22630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789597131.119857:0:22608:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789597131.119870:0:22608:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789597131.122907:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+5:22592:x1876527984905984:12345-0@lo:253:mount.lustre.0 Request processed in 15609us (15934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.122946:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789597131.123194:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984905984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789597131.123209:0:22592:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789597131.123221:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789597131.123222:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789597131.123224:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597131.123225:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597131.123226:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597131.123227:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597131.123229:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789597131.123230:0:22592:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789597131.123232:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597131.123233:0:22592:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789597131.123253:0:22592:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7d83162800 from lustre-MDT0000 10000000:01000000:1.0:1789597131.123281:0:22592:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789597131.123284:0:22592:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789597131.123289:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c7ebbcb0000 10000000:01000000:1.0:1789597131.123293:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789597131.123301:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7ebbcb0000 from 1 10000000:01000000:1.0:1789597131.123304:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789597131.123405:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.123417:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.123428:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.123449:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597131.123758:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.123843:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789597131.123887:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984906112 00000100:00100000:0.0:1789597131.123896:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984906112 00000100:00100000:0.0:1789597131.123990:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597131.124010:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+5:22592:x1876527984906112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597131.124022:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597131.124041:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4400/0x7b5398e289bc02b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc02aa expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.124067:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4400/0x7b5398e289bc02b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc02aa expref: 6 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.124089:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4400/0x7b5398e289bc02b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc02aa expref: 6 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.124099:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4400, rc 0) 00000100:00100000:0.0:1789597131.124179:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+6:22592:x1876527984906112:12345-0@lo:101:mount.lustre.0 Request processed in 180us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597131.124186:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789597131.124355:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597131.124368:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.124386:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.124438:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597131.124472:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.125121:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789597131.125191:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984906240 00000100:00100000:3.0:1789597131.125197:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984906240 00000100:00100000:3.0:1789597131.125226:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789597131.125233:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+6:22592:x1876527984906240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597131.125320:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+6:22592:x1876527984906240:12345-0@lo:501:mount.lustre.0 Request processed in 87us (847us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789597131.125336:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789597131.125451:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906240:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789597131.125496:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789597131.125517:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.125527:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597131.125545:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7d83162800 10000000:01000000:1.0:1789597131.125549:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789597131.125553:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c7d83162800 10000000:01000000:1.0:1789597131.125556:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789597131.125559:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c7d83162800 from 1 10000000:01000000:1.0:1789597131.125561:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789597131.125581:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743e00/0x7b5398e289bc02b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.125588:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83743e00/0x7b5398e289bc02b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.125596:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83743e00/0x7b5398e289bc02b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.125829:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597131.125862:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.125880:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789597131.125942:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984906368 00000100:00100000:3.0:1789597131.125947:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984906368 00000100:00100000:3.0:1789597131.125979:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789597131.125985:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+6:22592:x1876527984906368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597131.125995:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597131.126134:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80030000/0x7b5398e289bc02bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc02b8 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.126154:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80030000/0x7b5398e289bc02bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc02b8 expref: 7 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.126165:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80030000/0x7b5398e289bc02bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc02b8 expref: 7 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.126173:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80030000, rc 0) 00000100:00100000:3.0:1789597131.126213:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+7:22592:x1876527984906368:12345-0@lo:101:mount.lustre.0 Request processed in 228us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.126219:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789597131.126294:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597131.126306:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83743e00/0x7b5398e289bc02b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02bf expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.126315:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83743e00/0x7b5398e289bc02b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc02bf expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597131.126338:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789597131.126350:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743e00/0x7b5398e289bc02b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02bf expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.126357:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743e00/0x7b5398e289bc02b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02bf expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597131.126363:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789597131.126366:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789597131.126370:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c7d83162800 10000000:01000000:1.0:1789597131.126373:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789597131.126376:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789597131.126378:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789597131.126391:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743c00/0x7b5398e289bc02c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.126397:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83743c00/0x7b5398e289bc02c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.126410:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83743c00/0x7b5398e289bc02c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.126422:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597131.126446:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597131.126601:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984906496 00000100:00100000:3.0:1789597131.126613:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984906496 00000100:00100000:3.0:1789597131.126633:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789597131.126638:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+7:22592:x1876527984906496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597131.126646:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597131.126654:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80031600/0x7b5398e289bc02cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc02c6 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.126666:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031600/0x7b5398e289bc02cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc02c6 expref: 8 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.126674:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80031600/0x7b5398e289bc02cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc02c6 expref: 8 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.126701:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031600, rc 0) 00000100:00100000:3.0:1789597131.126725:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+8:22592:x1876527984906496:12345-0@lo:101:mount.lustre.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.126731:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789597131.126910:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.126922:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597131.126932:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83743c00/0x7b5398e289bc02c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02cd expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.126940:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83743c00/0x7b5398e289bc02c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc02cd expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.127110:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597131.127133:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.127145:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789597131.127212:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984906624 00000100:00100000:0.0:1789597131.127217:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984906624 00000100:00100000:0.0:1789597131.127239:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789597131.127246:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+8:22592:x1876527984906624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597131.127381:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+9:22592:x1876527984906624:12345-0@lo:501:mount.lustre.0 Request processed in 134us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597131.127388:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789597131.127722:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597131.127764:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597131.127818:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.127837:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789597131.127886:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984906752 00000100:00100000:0.0:1789597131.127890:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984906752 00000100:00100000:0.0:1789597131.127921:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789597131.127928:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+9:22592:x1876527984906752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597131.129389:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+9:22592:x1876527984906752:12345-0@lo:503:mount.lustre.0 Request processed in 1453us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.129406:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597131.129589:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984906752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789597131.130672:0:22631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22631:1876527984906880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789597131.130756:0:22631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597131.130813:0:22631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597131.130877:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984906880 00000100:00100000:3.0:1789597131.130884:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984906880 00000100:00100000:3.0:1789597131.130923:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789597131.130931:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+9:22631:x1876527984906880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789597131.131823:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+9:22631:x1876527984906880:12345-0@lo:502:llog_process_th.0 Request processed in 887us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.131832:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597131.132444:0:22631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22631:1876527984906880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789597131.132562:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789597131.132577:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597131.132579:0:22631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789597131.132584:0:22631:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789597131.132588:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789597131.132700:0:22631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c7eb98bcd40) 00000020:00000080:2.0:1789597131.132720:0:22631:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789597131.132726:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789597131.132821:0:22631:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789597131.132828:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc02db 00000020:00000080:3.0:1789597131.133822:0:22631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789597131.133831:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597131.133839:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.133841:0:22631:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789597131.133856:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597131.133861:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.133862:0:22631:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789597131.133866:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789597131.133877:0:22631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c7eb76cb380) 00000020:00000080:3.0:1789597131.133890:0:22631:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789597131.133894:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789597131.133897:0:22631:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789597131.133899:0:22631:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789597131.133905:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789597131.133987:0:22631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d83162800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789597131.134077:0:22631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c7d820cb380) 00000020:00000080:3.0:1789597131.134087:0:22631:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789597131.134147:0:22631:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789597131.134153:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bc02f0 00000020:00000080:3.0:1789597131.134250:0:22631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789597131.134256:0:22631:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789597131.134260:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7b5398e289bc02f7 00080000:01000000:3.0:1789597131.134265:0:22631:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789597131.134269:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc02fe 00010000:00010000:1.0:1789597131.246425:0:22631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789597131.247166:0:22631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1789597131.247531:0:22631:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789597131.248309:0:22631:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c7ebbcb4d40) 00000020:00000080:1.0:1789597131.248344:0:22631:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789597131.248434:0:22631:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789597131.248442:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc030c 00000020:00000080:1.0:1789597131.259433:0:22631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789597131.264232:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7b5398e289bc0313 00000020:00000080:3.0:1789597131.264935:0:22631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789597131.264949:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597131.264957:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.264960:0:22631:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789597131.264962:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789597131.264966:0:22631:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1789597131.264967:0:22631:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789597131.264969:0:22631:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789597131.264971:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789597131.264973:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.264974:0:22631:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789597131.264976:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597131.264981:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.264982:0:22631:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789597131.264991:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789597131.265042:0:22631:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789597131.265056:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597131.265059:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.265060:0:22631:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789597131.265063:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597131.265065:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.265067:0:22631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789597131.265069:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789597131.265074:0:22631:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:3.0:1789597131.265097:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789597131.265111:0:22631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c7d820c99c0) 00000020:00000080:3.0:1789597131.265124:0:22631:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789597131.265127:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789597131.265188:0:22631:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789597131.265193:0:22631:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789597131.265198:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc0321 00010000:00080000:3.0:1789597131.265227:0:22631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb9b5f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789597131.269952:0:22631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789597131.271911:0:22631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789597131.271925:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789597131.271960:0:22631:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789597131.271979:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bc0328 00000100:00080000:0.0:1789597131.271991:0:22631:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789597131.272011:0:22631:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597131.272045:0:22631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f0b100 x1876527984907008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789597131.272084:0:22631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789597131.272141:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984907008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789597131.272218:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597131.272308:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984907008 00000100:00100000:3.0:1789597131.272317:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984907008 00000100:00100000:3.0:1789597131.272625:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789597131.272633:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984907008:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789597131.272650:0:22618:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789597131.277932:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984907136:0@lo:400:kworker.0 00000100:00100000:0.0:1789597131.278062:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789597131.278213:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597131.278219:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.278221:0:22631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789597131.278224:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789597131.278226:0:22631:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789597131.278228:0:22631:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789597131.278230:0:22631:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789597131.278231:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789597131.278233:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.278235:0:22631:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789597131.278237:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789597131.278242:0:22631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789597131.278245:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.278246:0:22631:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789597131.278249:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789597131.278252:0:22631:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:0.0:1789597131.278278:0:22631:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789597131.278280:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789597131.278294:0:22631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c7eb557cd40) 00000020:00000080:0.0:1789597131.278311:0:22631:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789597131.278316:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789597131.278392:0:22631:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789597131.278397:0:22631:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789597131.278403:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc0336 00010000:00080000:0.0:1789597131.278438:0:22631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e9e294000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.116@tcp at head 00000100:00100000:2.0:1789597131.279453:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984907136 00000100:00100000:2.0:1789597131.279528:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984907136 00000100:00100000:2.0:1789597131.279589:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597131.279598:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+9:3647:x1876527984907136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597131.279763:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+9:3647:x1876527984907136:12345-0@lo:400:kworker.0 Request processed in 165us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597131.279771:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789597131.280133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984907136:0@lo:400:kworker.0 00010000:00010000:0.0:1789597131.281437:0:22631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789597131.286230:0:22631:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789597131.286788:0:22631:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789597131.291981:0:22631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789597131.293153:0:22631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1789597131.301768:0:22631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1789597131.303236:0:22637:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789597131.303242:0:22637:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1789597131.303320:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984907008:12345-0@lo:38:llog_process_th.0 Request processed in 30681us (31096us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789597131.303343:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1789597131.304083:0:22631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789597131.304097:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789597131.304141:0:22631:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789597131.304163:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bc033d 00000100:00080000:3.0:1789597131.304173:0:22631:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789597131.304184:0:22631:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7e9e294000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597131.304220:0:22631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb458ad80 x1876527984907264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597131.304238:0:22631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789597131.304310:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597131.304314:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.304316:0:22631:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789597131.304319:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789597131.304321:0:22631:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789597131.304323:0:22631:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789597131.304324:0:22631:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789597131.304326:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789597131.304328:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.304329:0:22631:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789597131.304332:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789597131.304336:0:22631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789597131.304339:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.304340:0:22631:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789597131.304342:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789597131.304346:0:22631:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:3.0:1789597131.304368:0:22631:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789597131.304371:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789597131.304383:0:22631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c7d820ccd40) 00000020:00000080:3.0:1789597131.304394:0:22631:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789597131.304398:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789597131.304450:0:22631:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789597131.304461:0:22631:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789597131.304468:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7b5398e289bc034b 00010000:00080000:3.0:1789597131.304494:0:22631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e867d7000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789597131.304715:0:22631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789597131.304780:0:22631:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789597131.304795:0:22631:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:1.0:1789597131.309229:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597131.309240:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789597131.309246:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984907008:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789597131.309278:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984907264:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789597131.309339:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984907264 offset 0 length 520: 4 00000040:00080000:3.0:1789597131.309403:0:22631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789597131.309964:0:22631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789597131.310308:0:22631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1789597131.310762:0:22639:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789597131.310768:0:22639:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789597131.311491:0:22631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789597131.311504:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789597131.311540:0:22631:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789597131.311561:0:22631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bc0352 00000100:00080000:3.0:1789597131.311573:0:22631:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789597131.311586:0:22631:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7e867d7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597131.311625:0:22631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb4589500 x1876527984907392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597131.311654:0:22631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789597131.311750:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984907392:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789597131.311796:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984907392 offset 0 length 520: 4 00000020:01000000:3.0:1789597131.311929:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597131.311933:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.311935:0:22631:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789597131.311938:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597131.311942:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.311943:0:22631:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789597131.311946:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789597131.311948:0:22631:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789597131.311950:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597131.311952:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.311953:0:22631:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789597131.311962:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597131.311965:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.311966:0:22631:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789597131.311970:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789597131.312007:0:22631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22631:1876527984907520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789597131.312055:0:22631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597131.312071:0:22631:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e86982900 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.312390:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984907520 00000100:00100000:1.0:1789597131.312397:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984907520 00000100:00100000:1.0:1789597131.312449:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789597131.312469:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+9:22631:x1876527984907520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789597131.312613:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+9:22631:x1876527984907520:12345-0@lo:502:llog_process_th.0 Request processed in 134us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.312621:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789597131.312910:0:22631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22631:1876527984907520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789597131.312938:0:22631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597131.312944:0:22631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597131.312945:0:22631:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789597131.312949:0:22631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789597131.313278:0:22592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789597131.313305:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789597131.313419:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743c00/0x7b5398e289bc02c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02cd expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.313445:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743c00/0x7b5398e289bc02c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02cd expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597131.313453:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d83162800 from 1 10000000:01000000:1.0:1789597131.313514:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789597131.313546:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.313554:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.313563:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.313581:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984907648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597131.313871:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.313937:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597131.314068:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984907648 00000100:00100000:0.0:1789597131.314075:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984907648 00000100:00100000:0.0:1789597131.314143:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789597131.314152:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+9:22592:x1876527984907648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597131.314166:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597131.314180:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0359 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.314205:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 10 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.314216:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 10 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.314225:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5200, rc 0) 00000100:00100000:0.0:1789597131.314271:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+10:22592:x1876527984907648:12345-0@lo:101:mount.lustre.0 Request processed in 121us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597131.314277:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789597131.314357:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984907648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597131.314421:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597131.314431:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597131.315067:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984907776:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789597131.315176:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597131.315873:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.315960:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984907776 00000100:00100000:1.0:1789597131.315969:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984907776 00000100:00100000:1.0:1789597131.316018:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597131.316027:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+10:22592:x1876527984907776:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789597131.316045:0:22608:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789597131.316052:0:22608:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789597131.316145:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+10:22592:x1876527984907776:12345-0@lo:256:mount.lustre.0 Request processed in 118us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.316152:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789597131.316258:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984907776:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789597131.317030:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789597131.317048:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597131.317061:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597131.317069:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d83162800 from 1 10000000:01000000:2.0:1789597131.317072:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789597131.317105:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597131.317113:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597131.317122:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597131.317142:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984907904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789597131.317183:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597131.317209:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.317369:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984907904 00000100:00100000:1.0:1789597131.317383:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984907904 00000100:00100000:1.0:1789597131.317411:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789597131.317419:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+10:22592:x1876527984907904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597131.317431:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597131.317443:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0367 expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.317575:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 11 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.317587:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 11 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.317596:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742a00, rc 0) 00000100:00100000:1.0:1789597131.317731:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+11:22592:x1876527984907904:12345-0@lo:101:mount.lustre.0 Request processed in 312us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.317737:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789597131.317943:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984907904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597131.317958:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597131.317976:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597131.318047:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597131.318073:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597131.318101:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.318201:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908032 00000100:00100000:1.0:1789597131.318206:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908032 00000100:00100000:1.0:1789597131.318228:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597131.318234:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+11:22592:x1876527984908032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597131.318374:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+11:22592:x1876527984908032:12345-0@lo:501:mount.lustre.0 Request processed in 139us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.318380:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789597131.318546:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597131.318587:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789597131.318631:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597131.318649:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.318797:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908160 00000100:00100000:1.0:1789597131.318814:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908160 00000100:00100000:1.0:1789597131.318837:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789597131.318842:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+11:22592:x1876527984908160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597131.318949:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+11:22592:x1876527984908160:12345-0@lo:503:mount.lustre.0 Request processed in 106us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.318956:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789597131.319097:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597131.319730:0:22641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22641:1876527984908288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789597131.319773:0:22641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597131.319812:0:22641:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789597131.319929:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908288 00000100:00100000:2.0:1789597131.319934:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908288 00000100:00100000:2.0:1789597131.319957:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597131.319964:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+11:22641:x1876527984908288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789597131.320526:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+11:22641:x1876527984908288:12345-0@lo:502:llog_process_th.0 Request processed in 561us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597131.320534:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789597131.320916:0:22641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22641:1876527984908288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789597131.320941:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597131.320955:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.320957:0:22641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789597131.320963:0:22641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7d83162800 00000020:00000080:0.0:1789597131.320965:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789597131.320972:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597131.320974:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.320976:0:22641:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789597131.320978:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597131.320980:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.320981:0:22641:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789597131.320984:0:22641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7d83162800 00000020:00000080:0.0:1789597131.320986:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789597131.321043:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597131.321045:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.321046:0:22641:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789597131.321048:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597131.321050:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.321052:0:22641:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789597131.321055:0:22641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7d83162800 00000020:00000080:0.0:1789597131.321057:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789597131.321070:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597131.321073:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.321074:0:22641:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789597131.321076:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597131.321078:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.321079:0:22641:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789597131.321082:0:22641:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7d83162800 00000020:00000080:0.0:1789597131.321084:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789597131.321116:0:22641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22641:1876527984908416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789597131.321149:0:22641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597131.321180:0:22641:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912fc780 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.321283:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908416 00000100:00100000:1.0:1789597131.321288:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908416 00000100:00100000:1.0:1789597131.321332:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789597131.321339:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+11:22641:x1876527984908416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789597131.321410:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+11:22641:x1876527984908416:12345-0@lo:502:llog_process_th.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.321417:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789597131.322737:0:22641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22641:1876527984908416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789597131.322778:0:22641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597131.322784:0:22641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597131.322786:0:22641:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789597131.322790:0:22641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789597131.322960:0:22592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789597131.322981:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789597131.323006:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.323018:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597131.323074:0:22592:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789597131.323077:0:22592:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7d83162800 10000000:01000000:1.0:1789597131.323080:0:22592:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7d83162800 10000000:01000000:1.0:1789597131.323084:0:22592:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789597131.323090:0:22592:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7d83162800 from 1 10000000:01000000:1.0:1789597131.323092:0:22592:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789597131.323127:0:22592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743a00/0x7b5398e289bc0375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.323136:0:22592:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83743a00/0x7b5398e289bc0375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.323151:0:22592:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83743a00/0x7b5398e289bc0375 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.323170:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597131.323218:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.323262:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.323279:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908544 00000100:00100000:1.0:1789597131.323284:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908544 00000100:00100000:1.0:1789597131.323313:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789597131.323320:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+11:22592:x1876527984908544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597131.323341:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597131.323352:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743400/0x7b5398e289bc037c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0375 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.323373:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743400/0x7b5398e289bc037c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0375 expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.323382:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743400/0x7b5398e289bc037c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0375 expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.323390:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743400, rc 0) 00000100:00100000:1.0:1789597131.323418:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22592:x1876527984908544:12345-0@lo:101:mount.lustre.0 Request processed in 99us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.323424:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789597131.323455:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597131.324031:0:22592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83743a00/0x7b5398e289bc0375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc037c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597131.324050:0:22592:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83743a00/0x7b5398e289bc0375 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc037c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597131.324103:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597131.324134:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.324153:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.324173:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908672 00000100:00100000:1.0:1789597131.324177:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908672 00000100:00100000:1.0:1789597131.324203:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789597131.324209:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22592:x1876527984908672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597131.325155:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22592:x1876527984908672:12345-0@lo:501:mount.lustre.0 Request processed in 937us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.325167:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789597131.334077:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597131.334171:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597131.334254:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597131.334303:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912fc780 going to sleep for 11 seconds 00000100:00100000:1.0:1789597131.335720:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908800 00000100:00100000:1.0:1789597131.335733:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908800 00000100:00100000:1.0:1789597131.335796:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789597131.335820:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+12:22592:x1876527984908800:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597131.335991:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+12:22592:x1876527984908800:12345-0@lo:503:mount.lustre.0 Request processed in 175us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597131.336012:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789597131.336194:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984908800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789597131.343194:0:22645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22645:1876527984908928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789597131.343280:0:22645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597131.343315:0:22645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710540 going to sleep for 11 seconds 00000100:00100000:3.0:1789597131.345102:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984908928 00000100:00100000:3.0:1789597131.345115:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984908928 00000100:00100000:3.0:1789597131.345209:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789597131.345220:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:22645:x1876527984908928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789597131.345389:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:22645:x1876527984908928:12345-0@lo:502:llog_process_th.0 Request processed in 171us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.345397:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789597131.345501:0:22645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22645:1876527984908928:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789597131.345568:0:22645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789597131.345588:0:22645:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c7eb98b8000) 00000020:00000080:2.0:1789597131.345617:0:22645:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789597131.345735:0:22645:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d83162800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789597131.345739:0:22645:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7d83162800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789597131.345742:0:22645:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7d83162800 4 00010000:00080000:2.0:1789597131.345768:0:22645:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb6635000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789597131.347326:0:22645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789597131.355001:0:22645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789597131.355054:0:22645:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789597131.355072:0:22645:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7b5398e289bc038a 00000100:00080000:1.0:1789597131.355085:0:22645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789597131.355100:0:22645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c7eb6635000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597131.355143:0:22645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb026680 x1876527984909056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597131.355186:0:22645:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789597131.355551:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984909056:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789597131.355702:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.355740:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909056 00000100:00100000:1.0:1789597131.355749:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909056 00000100:00100000:1.0:1789597131.355777:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789597131.355784:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984909056:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789597131.355927:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984909056:12345-0@lo:38:llog_process_th.0 Request processed in 141us (224us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789597131.355935:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789597131.356032:0:22645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22645:1876527984909184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789597131.356073:0:22645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.356094:0:22645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e90fb36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789597131.356112:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909184 00000100:00100000:2.0:1789597131.356117:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909184 00000100:00100000:2.0:1789597131.356149:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789597131.356156:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22645:x1876527984909184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789597131.356258:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22645:x1876527984909184:12345-0@lo:502:llog_process_th.0 Request processed in 102us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597131.356265:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597131.356282:0:22645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22645:1876527984909184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789597131.356320:0:22645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22645:1876527984909312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789597131.356350:0:22645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597131.356362:0:22645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e90fb36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597131.356421:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789597131.356426:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6635000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597131.356429:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789597131.356431:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984909056:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789597131.356442:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909312 00000100:00100000:3.0:1789597131.356445:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909312 00000100:00100000:3.0:1789597131.356542:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789597131.356549:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:22645:x1876527984909312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789597131.356703:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:22645:x1876527984909312:12345-0@lo:502:llog_process_th.0 Request processed in 155us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.356710:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789597131.356720:0:22645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:980ee822-f655-4df0-a283-f316bd6c264b:22645:1876527984909312:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789597131.356737:0:22645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789597131.356842:0:22592:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789597131.356863:0:22592:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789597131.356877:0:22592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743a00/0x7b5398e289bc0375 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc037c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.356888:0:22592:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743a00/0x7b5398e289bc0375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc037c expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789597131.356931:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789597131.356933:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789597131.356934:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789597131.356935:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789597131.356936:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789597131.356938:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789597131.356939:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789597131.356941:0:22592:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789597131.356942:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789597131.356943:0:22592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789597131.356947:0:22592:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789597131.356949:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789597131.356950:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789597131.356955:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789597131.356956:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789597131.356957:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789597131.356958:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789597131.356959:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789597131.356960:0:22592:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789597131.356961:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789597131.356962:0:22592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789597131.356974:0:22592:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789597131.356982:0:22592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984909440:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789597131.357394:0:22592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597131.357418:0:22592:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912fc300 going to sleep for 11 seconds 00000100:00100000:3.0:1789597131.357540:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909440 00000100:00100000:3.0:1789597131.357545:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909440 00000100:00100000:3.0:1789597131.357581:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789597131.357589:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22592:x1876527984909440:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789597131.362658:0:22606:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789597131.362694:0:22606:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789597131.365102:0:22606:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789597131.365125:0:22606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789597131.365285:0:22629:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789597131.365290:0:22629:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789597131.365317:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.365340:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.365349:0:22629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.365392:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 12 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597131.365407:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 12 pid: 22606 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597131.365422:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984909568:0@lo:104: 00000100:00100000:3.0:1789597131.365451:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22592:x1876527984909440:12345-0@lo:253:mount.lustre.0 Request processed in 7862us (8057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597131.365460:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597131.365506:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912fcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789597131.365531:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789597131.365599:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909568 00000100:00100000:3.0:1789597131.365606:0:22596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909568 00000100:00100000:3.0:1789597131.366450:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789597131.366478:0:22596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984909568:12345-0@lo:104: 00010000:00010000:3.0:1789597131.366496:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.366569:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789597131.366575:0:22596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984909568:12345-0@lo:104: Request processed in 104us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.366582:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789597131.370190:0:22592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:22592:1876527984909440:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789597131.370212:0:22592:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789597131.370216:0:22592:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789597131.370218:0:22592:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789597131.370219:0:22592:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597131.370221:0:22592:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597131.370222:0:22592:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597131.370224:0:22592:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597131.370225:0:22592:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789597131.370236:0:22592:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789597131.370238:0:22592:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597131.370239:0:22592:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789597131.370256:0:22592:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789597131.374193:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984909568:0@lo:104: 00010000:00010000:0.0:1789597131.374239:0:22629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.377889:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597131.377906:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.377917:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:3.0:1789597131.377922:0:22602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.377933:0:22602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789597131.377941:0:22602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597131.377947:0:22602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789597131.377993:0:22602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378073:0:22602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789597131.378107:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378114:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc0359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0360 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378134:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597131.378136:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597131.378137:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597131.378189:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789597131.378208:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984909696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789597131.378279:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597131.378566:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909696 00000100:00100000:3.0:1789597131.378585:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909696 00010000:00010000:3.0:1789597131.378615:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 12 pid: 22606 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597131.378655:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789597131.378665:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+12:3645:x1876527984909696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597131.378713:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597131.378719:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 12 pid: 22606 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378731:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 12 pid: 22606 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378745:0:22598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e5200/0x7b5398e289bc0360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc0359 expref: 12 pid: 22606 timeout: 806 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378761:0:22598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378769:0:22598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789597131.378783:0:22598:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013493171s 00010000:00010000:3.0:1789597131.378787:0:22598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378795:0:22598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378813:0:22598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378834:0:22598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378841:0:22598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597131.378845:0:22598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378853:0:22598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378871:0:22598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378881:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597131.378925:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+11:3645:x1876527984909696:12345-0@lo:103:ldlm_bl.0 Request processed in 261us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597131.378932:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789597131.378960:0:22629:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378968:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597131.378975:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc0391 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597131.380126:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984909696:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789597131.388178:0:22592:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1789597131.388586:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789597131.388762:0:22652:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1789597131.388766:0:22652:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1789597131.388953:0:22653:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789597131.389211:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789597131.389568:0:22653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789597131.391839:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789597131.391886:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789597131.393615:0:22592:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789597131.393638:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789597131.393747:0:22592:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789597131.395370:0:22654:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c7eb0c22300 x1876527984909824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597131.395385:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000040:00080000:1.0:1789597131.395809:0:22653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789597131.395869:0:22653:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789597131.397096:0:22592:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789597131.398873:0:22592:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789597131.398951:0:22592:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789597131.400559:0:22592:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1789597131.401390:0:22592:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1789597131.404982:0:22592:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789597131.407160:0:22592:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789597131.407204:0:22592:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc0dc419df988 00100000:10000000:0.0:1789597131.407214:0:22592:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789597131.407974:0:22592:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789597131.407991:0:22592:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789597131.408094:0:22592:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789597131.408117:0:22592:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789597131.409405:0:22592:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789597131.411231:0:22592:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789597131.968966:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597132.412772:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000040:00080000:0.0:1789597132.419279:0:22649:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789597132.419291:0:22649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789597132.424808:0:22649:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789597132.424826:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1789597132.861024:0:22610:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789597132.861032:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d83162800 from 11 10000000:01000000:0.0:1789597132.861038:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789597132.861100:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597132.861124:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597132.861137:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597132.861163:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984909952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789597132.861242:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597132.861288:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710780 going to sleep for 11 seconds 00000100:00100000:1.0:1789597132.861355:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909952 00000100:00100000:1.0:1789597132.861363:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909952 00000100:00100000:1.0:1789597132.861412:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789597132.861421:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+11:22610:x1876527984909952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597132.861434:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597132.861446:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0398 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597132.861470:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597132.861481:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597132.861490:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742200, rc 0) 00000100:00100000:1.0:1789597132.861589:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:22610:x1876527984909952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597132.861597:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597132.862916:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984909952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597132.862944:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597132.862956:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597132.863020:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984910080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789597132.863068:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597132.863106:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83ddac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597132.863125:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984910080 00000100:00100000:2.0:1789597132.863131:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984910080 00000100:00100000:2.0:1789597132.863166:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789597132.863173:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22610:x1876527984910080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789597132.863201:0:22606:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789597132.863215:0:22606:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789597132.863218:0:22606:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789597132.863285:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:22610:x1876527984910080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597132.863292:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789597132.863327:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984910080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789597132.863360:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789597132.863366:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597132.863375:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597132.989845:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597133.436766:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000040:00080000:0.0:1789597133.437489:0:22649:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789597133.437496:0:22649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789597133.441334:0:22649:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1789597133.441405:0:22649:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789597133.441605:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1789597134.012866:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597134.460751:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:1.0:1789597135.040598:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597135.490412:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:1.0:1789597136.064588:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597136.509241:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000001:02000400:2.0:1789597136.782246:0:22899:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1789597136.830973:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789597136.830980:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789597136.830985:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597136.830995:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 706 00000100:00080000:0.0:1789597136.831001:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789597136.831014:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597136.831037:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f08e00 x1876527984910336/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789597136.831054:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597136.831058:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597136.831074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597136.831077:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597136.831080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789597136.831083:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789597136.831085:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6635000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597136.831092:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c7eb6635000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597136.831104:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f0ad80 x1876527984910464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789597136.831149:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984910336:0@lo:38:kworker.0 00000100:00100000:0.0:1789597136.831225:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597136.831583:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597136.831595:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984910208:0@lo:400:kworker.0 00000100:00100000:2.0:1789597136.831638:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597136.831742:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984910336 00000100:00100000:2.0:1789597136.831766:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984910336 00000100:00100000:2.0:1789597136.831802:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789597136.831817:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984910336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789597136.831836:0:22619:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597136.831890:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984910336:12345-0@lo:38:kworker.0 Request processed in 73us (665us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597136.831897:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789597136.831919:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984910208 00000100:00100000:2.0:1789597136.831923:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984910208 00000100:00100000:2.0:1789597136.831952:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789597136.831959:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:3644:x1876527984910208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597136.831997:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:3644:x1876527984910208:12345-0@lo:400:kworker.0 Request processed in 39us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597136.832003:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789597136.832047:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984910208:0@lo:400:kworker.0 00000100:00080000:0.0:1789597136.832272:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789597136.832278:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789597136.832282:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984910336:0@lo:38:kworker.0 00000100:00100000:0.0:1789597136.832288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984910464:0@lo:38:kworker.0 00000100:00100000:0.0:1789597136.832319:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597136.834448:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984910464 00000100:00100000:2.0:1789597136.834465:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984910464 00000100:00100000:2.0:1789597136.834517:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789597136.834526:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984910464:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789597136.834558:0:22615:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 711 last 0 00000020:00000080:2.0:1789597136.834602:0:22615:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7b5398e289bc03a6 00000004:00100000:2.0:1789597136.834621:0:22615:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789597136.834820:0:22615:0:(import.c:65:import_set_state_nolock()) ffff9c7eb65c6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597136.834928:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876527984910464:12345-0@lo:38:kworker.0 Request processed in 402us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597136.834936:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789597136.835012:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7e85f0ad80 x1876527984910464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789597136.835041:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789597136.835049:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789597136.835054:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789597136.835057:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb6635000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789597136.835063:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876527984910464:0@lo:38:kworker.0 00010000:00010000:1.0:1789597137.085815:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597137.534083:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000020:00000004:1.0:1789597137.857340:0:22951:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789597137.857626:0:22951:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789597138.110803:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597138.559331:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000020:00000004:2.0:1789597138.764434:0:23001:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789597138.764970:0:23001:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789597139.133535:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597139.580781:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:2.0:1789597140.166561:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597140.607504:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:1.0:1789597141.188542:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597141.639100:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000100:00080000:3.0:1789597141.955867:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789597141.955875:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789597141.955879:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597141.955902:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 711 00000100:00080000:3.0:1789597141.955908:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789597141.955921:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597141.955946:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb458a680 x1876527984910720/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597141.955960:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597141.955964:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789597141.955966:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597141.955969:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789597141.956002:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980ee822-f655-4df0-a283-f316bd6c264b:3646:1876527984910592:0@lo:400:kworker.0 00000100:00100000:3.0:1789597141.956099:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597141.956168:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789597141.956175:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984910848:0@lo:400:kworker.0 00000100:00100000:3.0:1789597141.956217:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597141.956275:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984910848 00000100:00100000:3.0:1789597141.956283:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984910848 00000100:00100000:3.0:1789597141.956563:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789597141.956574:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984910848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597141.956652:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984910848:12345-0@lo:400:kworker.0 Request processed in 79us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597141.956659:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789597141.956751:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7eb4589c00 x1876527984910848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597141.956764:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984910848:0@lo:400:kworker.0 00000100:00100000:0.0:1789597141.959258:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984910592 00000100:00100000:0.0:1789597141.959277:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984910592 00000100:00100000:0.0:1789597141.959359:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789597141.959370:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+12:3646:x1876527984910592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597141.959465:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+12:3646:x1876527984910592:12345-0@lo:400:kworker.0 Request processed in 97us (3365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597141.959472:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789597141.961205:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980ee822-f655-4df0-a283-f316bd6c264b:3646:1876527984910592:0@lo:400:kworker.0 00000100:00100000:2.0:1789597141.966189:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597131/real 1789597131] req@ffff9c7eb4589500 x1876527984907392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597141 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597141.966221:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb4589500 x1876527984907392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597141 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597141.966232:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597131/real 1789597131] req@ffff9c7eb458ad80 x1876527984907264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597141 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597141.966244:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb458ad80 x1876527984907264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597141 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597141.966269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984910720:0@lo:38:kworker.0 00000100:00100000:2.0:1789597141.966411:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789597141.966451:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597141.966466:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789597141.966498:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984907392:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789597141.966505:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e294000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597141.966511:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789597141.966514:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984907264:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789597141.966738:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597141.966744:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789597141.966747:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e294000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597141.966753:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 706 00000100:00080000:3.0:1789597141.966759:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789597141.966770:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7e9e294000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597141.966802:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb4589880 x1876527984910976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597141.966825:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597141.966829:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789597141.966830:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597141.966833:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 706 00000100:00080000:3.0:1789597141.966836:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789597141.966841:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7e867d7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597141.966853:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb4589c00 x1876527984911104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789597141.967315:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984910720 00000100:00100000:0.0:1789597141.967332:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984910720 00000100:00100000:0.0:1789597141.967382:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597141.967389:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984910720:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789597141.967408:0:22619:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789597141.967459:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984910720:12345-0@lo:38:kworker.0 Request processed in 69us (1047us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789597141.967466:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789597141.967790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984910976:0@lo:8:kworker.0 00000400:00000100:2.0:1789597141.967817:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984910976 offset 0 length 520: 4 00000100:00100000:2.0:1789597141.967842:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984911104:0@lo:8:kworker.0 00000400:00000100:2.0:1789597141.967875:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984911104 offset 0 length 520: 4 00000100:00080000:2.0:1789597141.967914:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597141.967919:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597141.967922:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984910720:0@lo:38:kworker.0 00010000:00010000:2.0:1789597142.208743:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597142.655995:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:2.0:1789597143.234914:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597143.676739:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000040:00080000:3.0:1789597143.678194:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789597144.253573:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597144.708437:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:2.0:1789597145.280221:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597145.724954:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:2.0:1789597146.301651:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597146.751234:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000100:00080000:3.0:1789597147.068808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789597147.068815:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789597147.068819:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597147.068832:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 716 00000100:00080000:3.0:1789597147.068837:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789597147.068855:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597147.068877:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb458b480 x1876527984911360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597147.068896:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597147.068900:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789597147.068903:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597147.068906:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597147.069026:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984911488:0@lo:400:kworker.0 00000100:00100000:1.0:1789597147.069089:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597147.069145:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789597147.069150:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984911232:0@lo:400:kworker.0 00000100:00100000:1.0:1789597147.069183:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597147.069215:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984911232 00000100:00100000:1.0:1789597147.069222:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984911232 00000100:00100000:1.0:1789597147.069261:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789597147.069269:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:3645:x1876527984911232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597147.069447:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984911488 00000100:00100000:3.0:1789597147.069451:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984911488 00000100:00100000:1.0:1789597147.069543:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:3645:x1876527984911232:12345-0@lo:400:kworker.0 Request processed in 46us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.069798:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789597147.069807:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984911488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597147.069853:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984911488:12345-0@lo:400:kworker.0 Request processed in 48us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.069859:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789597147.069997:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789597147.070040:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984911232:0@lo:400:kworker.0 00010000:00080000:1.0:1789597147.070053:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7eb458a300 x1876527984911488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597147.070078:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984911488:0@lo:400:kworker.0 00000100:00100000:2.0:1789597147.070125:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984911360:0@lo:38:kworker.0 00000100:00100000:2.0:1789597147.070156:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597147.071560:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984911360 00000100:00100000:0.0:1789597147.071571:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984911360 00000100:00100000:0.0:1789597147.072590:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789597147.072600:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984911360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789597147.072620:0:22619:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789597147.072718:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984911360:12345-0@lo:38:kworker.0 Request processed in 117us (2560us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789597147.072725:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789597147.072810:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597147.072815:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597147.072819:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984911360:0@lo:38:kworker.0 00000020:01000004:1.0:1789597147.117086:0:23346:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789597147.117090:0:23346:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789597147.117092:0:23346:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789597147.117947:0:23346:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7eb98c4000 00000020:01000004:1.0:1789597147.117967:0:23346:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1789597147.117980:0:23346:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789597147.117994:0:23346:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c7ebbcb19c0) 00000020:00000080:1.0:1789597147.118011:0:23346:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789597147.183783:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789597147.184141:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789597147.193831:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789597147.196102:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789597147.197789:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789597147.198975:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789597147.199822:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789597147.200967:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789597147.201420:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789597147.202046:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789597147.202408:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789597147.203008:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789597147.203367:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789597147.204011:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1789597147.211498:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.212330:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.213297:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.214165:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.214964:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.215324:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.215918:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.216238:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.216918:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.217204:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.217807:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.218135:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.218850:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.219622:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.220222:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.220995:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.221298:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.221885:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.222310:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.222953:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.223248:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.223863:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.224287:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.224937:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.225216:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.225890:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.226298:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.226854:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.227163:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.227806:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789597147.228139:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789597147.228849:0:23346:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00080000:01000000:3.0:1789597147.229921:0:23346:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789597147.230204:0:23346:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789597147.230218:0:23346:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789597147.230243:0:23346:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bc03b4 00000020:01000004:3.0:1789597147.230251:0:23346:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789597147.230276:0:23346:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789597147.230279:0:23346:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789597147.230285:0:23346:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789597147.230312:0:23346:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789597147.230317:0:23346:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789597147.256814:0:23346:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789597147.256877:0:23346:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789597147.256882:0:23346:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789597147.256883:0:23346:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789597147.256885:0:23346:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597147.256886:0:23346:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597147.256887:0:23346:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597147.256889:0:23346:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597147.256890:0:23346:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789597147.256892:0:23346:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597147.256893:0:23346:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789597147.256897:0:23346:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789597147.256899:0:23346:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789597147.256901:0:23346:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789597147.256902:0:23346:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597147.256903:0:23346:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597147.256904:0:23346:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597147.256905:0:23346:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597147.256906:0:23346:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789597147.256907:0:23346:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597147.256908:0:23346:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789597147.256935:0:23346:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789597147.256960:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984911616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789597147.257046:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.257119:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e87d26840 going to sleep for 11 seconds 00000100:00100000:0.0:1789597147.257265:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984911616 00000100:00100000:0.0:1789597147.257284:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984911616 00000100:00100000:0.0:1789597147.257355:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789597147.257364:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:23346:x1876527984911616:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789597147.257393:0:22606:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789597147.257396:0:22606:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789597147.257403:0:22606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789597147.259190:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:23346:x1876527984911616:12345-0@lo:253:mount.lustre.0 Request processed in 1808us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.259204:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789597147.260263:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984911616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789597147.260393:0:23346:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789597147.260397:0:23346:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789597147.260398:0:23346:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789597147.260399:0:23346:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597147.260400:0:23346:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597147.260402:0:23346:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597147.260403:0:23346:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597147.260404:0:23346:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789597147.260407:0:23346:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597147.260408:0:23346:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789597147.261003:0:23346:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7eb98c4000 from lustre-MDT0001 10000000:01000000:0.0:1789597147.261037:0:23346:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789597147.261055:0:23346:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789597147.261061:0:23346:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7ebbcb0000 local copy 00010000:00010000:0.0:1789597147.261072:0:23346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597147.261383:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984911744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597147.261574:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597147.261718:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d826126c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597147.261995:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984911744 00000100:00100000:1.0:1789597147.262004:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984911744 00000100:00100000:1.0:1789597147.262094:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789597147.262103:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:23346:x1876527984911744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597147.268206:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+12:23346:x1876527984911744:12345-0@lo:501:mount.lustre.0 Request processed in 6090us (6618us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789597147.268224:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789597147.268933:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984911744:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789597147.268965:0:23346:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789597147.269022:0:23346:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789597147.269032:0:23346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.269043:0:23346:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597147.269079:0:23346:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7eb98c4000 10000000:01000000:3.0:1789597147.269084:0:23346:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789597147.269090:0:23346:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c7ebbcb0000 10000000:01000000:3.0:1789597147.269092:0:23346:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789597147.269096:0:23346:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c7ebbcb0000 from 1 10000000:01000000:3.0:1789597147.269098:0:23346:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789597147.269134:0:23346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bc03bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.269142:0:23346:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bc03bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.269153:0:23346:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bc03bb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597147.269808:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984911872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597147.269905:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.269976:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789597147.270115:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984911872 00000100:00100000:0.0:1789597147.270123:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984911872 00000100:00100000:0.0:1789597147.270190:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789597147.270200:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+12:23346:x1876527984911872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597147.270213:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597147.270229:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc03c2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc03bb expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.270253:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc03c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc03bb expref: 13 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.270265:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4600/0x7b5398e289bc03c2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc03bb expref: 13 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.270283:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4600, rc 0) 00000100:00100000:0.0:1789597147.270341:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+13:23346:x1876527984911872:12345-0@lo:101:mount.lustre.0 Request processed in 143us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.270348:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789597147.270920:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984911872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597147.270939:0:23346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bc03bb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03c2 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.270956:0:23346:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bc03bb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc03c2 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597147.270983:0:23346:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789597147.271004:0:23346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bc03bb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03c2 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.271018:0:23346:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80030200/0x7b5398e289bc03bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03c2 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597147.271030:0:23346:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c7eb98c4000 10000000:01000000:3.0:1789597147.271042:0:23346:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789597147.271047:0:23346:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c7eb98c4000 from 1 10000000:01000000:3.0:1789597147.271050:0:23346:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789597147.271080:0:23346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bc03c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.271088:0:23346:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bc03c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.271103:0:23346:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bc03c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597147.271140:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597147.271201:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.272205:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789597147.272712:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912000 00000100:00100000:2.0:1789597147.272721:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912000 00000100:00100000:1.0:1789597147.273168:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789597147.273191:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+13:23346:x1876527984912000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597147.273206:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597147.273224:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742e00/0x7b5398e289bc03d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc03c9 expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.273250:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742e00/0x7b5398e289bc03d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc03c9 expref: 14 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.273261:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742e00/0x7b5398e289bc03d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc03c9 expref: 14 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.273599:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742e00, rc 0) 00000100:00100000:1.0:1789597147.274038:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+14:23346:x1876527984912000:12345-0@lo:101:mount.lustre.0 Request processed in 848us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597147.274045:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789597147.274218:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597147.274239:0:23346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bc03c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03d0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.274249:0:23346:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bc03c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc03d0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597147.274267:0:23346:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789597147.274827:0:23346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bc03c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03d0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.274837:0:23346:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80030e00/0x7b5398e289bc03c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03d0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597147.274918:0:23346:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789597147.275047:0:23346:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789597147.275062:0:23346:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c7eb98c4000 10000000:01000000:2.0:1789597147.275067:0:23346:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789597147.275072:0:23346:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789597147.275075:0:23346:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789597147.275120:0:23346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc000/0x7b5398e289bc03d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.275128:0:23346:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc000/0x7b5398e289bc03d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.275137:0:23346:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc000/0x7b5398e289bc03d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597147.275165:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912128:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789597147.275589:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.275916:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e87d26840 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.276145:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912128 00000100:00100000:3.0:1789597147.276153:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912128 00000100:00100000:3.0:1789597147.276566:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789597147.276577:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+14:23346:x1876527984912128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597147.276591:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597147.276607:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80031400/0x7b5398e289bc03de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc03d7 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.276631:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031400/0x7b5398e289bc03de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc03d7 expref: 15 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.276925:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80031400/0x7b5398e289bc03de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc03d7 expref: 15 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.276934:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031400, rc 0) 00000100:00100000:3.0:1789597147.277012:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912128:12345-0@lo:101:mount.lustre.0 Request processed in 432us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.277019:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789597147.277107:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597147.277122:0:23346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc000/0x7b5398e289bc03d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03de expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.277130:0:23346:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc000/0x7b5398e289bc03d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc03de expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789597147.281479:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1789597147.282575:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789597147.297963:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789597147.298020:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1789597147.298033:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1789597147.298307:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1789597147.298385:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1789597147.298399:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1789597147.298412:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1789597147.298495:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1789597147.298514:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1789597147.298528:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1789597147.298541:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1789597147.298557:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1789597147.298570:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1789597147.298582:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1789597147.298595:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1789597147.298608:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1789597147.298622:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1789597147.299297:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1789597147.299520:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1789597147.299537:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1789597147.299550:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1789597147.299562:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1789597147.299576:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1789597147.299610:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1789597147.299625:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1789597147.301168:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1789597147.301402:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1789597147.301421:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1789597147.302091:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1789597147.302110:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1789597147.302123:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1789597147.302137:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1789597147.302151:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1789597147.302163:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1789597147.302189:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1789597147.302204:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1789597147.302218:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1789597147.302231:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1789597147.302244:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1789597147.302256:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1789597147.302268:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1789597147.302280:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1789597147.302293:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1789597147.302307:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1789597147.302349:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1789597147.302355:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1789597147.303525:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597147.303597:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597147.304062:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912256 00000100:00100000:0.0:1789597147.304072:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912256 00000100:00100000:0.0:1789597147.304127:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789597147.304149:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597147.304334:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912256:12345-0@lo:501:mount.lustre.0 Request processed in 186us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.304343:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789597147.304795:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.304825:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597147.305518:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789597147.305582:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.305620:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597147.305862:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912384 00000100:00100000:1.0:1789597147.305869:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912384 00000100:00100000:1.0:1789597147.305916:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789597147.305925:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597147.307371:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912384:12345-0@lo:503:mount.lustre.0 Request processed in 1440us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597147.307383:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789597147.308032:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912384:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789597147.309643:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789597147.309879:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.309959:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.310010:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597147.310555:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912512 00000100:00100000:1.0:1789597147.310565:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912512 00000100:00100000:1.0:1789597147.310621:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789597147.310639:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597147.313397:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912512:12345-0@lo:502:mount.lustre.0 Request processed in 2760us (3431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597147.313412:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789597147.313528:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789597147.313856:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789597147.313889:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789597147.313902:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789597147.313912:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789597147.313924:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789597147.313935:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789597147.313947:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789597147.313957:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789597147.313969:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789597147.313979:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789597147.313992:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789597147.314009:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789597147.314020:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789597147.314034:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789597147.314048:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789597147.314060:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789597147.314072:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789597147.314083:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789597147.314094:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789597147.314107:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789597147.314120:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789597147.314131:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789597147.314143:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789597147.314155:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789597147.314465:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789597147.314488:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789597147.314503:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789597147.314515:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789597147.314528:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789597147.314540:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789597147.314552:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789597147.314565:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789597147.314578:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789597147.314588:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789597147.314598:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789597147.314609:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789597147.314620:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789597147.314772:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789597147.314792:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789597147.314821:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789597147.314835:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789597147.314863:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789597147.314877:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789597147.314890:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789597147.314938:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912640:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.315003:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.315053:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597147.315414:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912640 00000100:00100000:1.0:1789597147.315433:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912640 00000100:00100000:1.0:1789597147.315479:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789597147.315489:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597147.315614:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984912640:12345-0@lo:502:mount.lustre.0 Request processed in 126us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597147.315622:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789597147.316037:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984912640:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789597147.316100:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789597147.316112:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789597147.319567:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597147.319583:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.319586:0:23350:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789597147.319592:0:23350:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789597147.319595:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789597147.319611:0:23350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c7eb55799c0) 00000020:00000080:0.0:1789597147.319645:0:23350:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789597147.319650:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789597147.319800:0:23350:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789597147.319807:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bc03ec 00000020:00000080:0.0:1789597147.320153:0:23350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789597147.320157:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597147.320161:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.320163:0:23350:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789597147.320165:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597147.320169:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.320170:0:23350:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789597147.320186:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789597147.320193:0:23350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c7eb5578000) 00000020:00000080:0.0:1789597147.320204:0:23350:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789597147.320207:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789597147.320209:0:23350:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789597147.320211:0:23350:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789597147.320217:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789597147.320268:0:23350:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7eb98c4000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789597147.320279:0:23350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c7eb557b380) 00000020:00000080:0.0:1789597147.320287:0:23350:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789597147.320505:0:23350:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789597147.320512:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bc0401 00000020:00000080:0.0:1789597147.320606:0:23350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789597147.320613:0:23350:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789597147.320617:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x7b5398e289bc0408 00080000:01000000:0.0:1789597147.320622:0:23350:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789597147.320625:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bc040f 00010000:00010000:2.0:1789597147.325002:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597147.464020:0:23350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789597147.465595:0:23350:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1789597147.467010:0:23350:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789597147.474096:0:23350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789597147.474112:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597147.474120:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.474122:0:23350:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789597147.474126:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597147.474133:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.474134:0:23350:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789597147.474137:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789597147.474143:0:23350:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:00000080:1.0:1789597147.474172:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789597147.474255:0:23350:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c7ebbcb3380) 00000020:00000080:1.0:1789597147.474279:0:23350:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789597147.474286:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789597147.475878:0:23350:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789597147.475890:0:23350:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789597147.475902:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bc041d 00010000:00080000:1.0:1789597147.475962:0:23350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e9d7d7800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789597147.493407:0:23350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789597147.534084:0:23350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789597147.534102:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789597147.534149:0:23350:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789597147.534172:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bc0424 00000100:00080000:1.0:1789597147.534394:0:23350:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789597147.534407:0:23350:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c7e9d7d7800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597147.534446:0:23350:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb027800 x1876527984912768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597147.534515:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984912768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789597147.534582:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789597147.534665:0:23350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789597147.534759:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597147.534764:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.534766:0:23350:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789597147.534769:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789597147.534783:0:23350:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789597147.534785:0:23350:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789597147.534787:0:23350:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789597147.534788:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789597147.534791:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.534793:0:23350:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789597147.534795:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597147.534800:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.534802:0:23350:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789597147.534805:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789597147.534851:0:23350:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789597147.534865:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597147.534868:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.534870:0:23350:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789597147.534872:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789597147.534874:0:23350:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789597147.534875:0:23350:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789597147.534877:0:23350:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789597147.534879:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789597147.534881:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.534882:0:23350:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789597147.534884:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789597147.534888:0:23350:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789597147.534890:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597147.534892:0:23350:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789597147.534894:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789597147.534898:0:23350:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:1.0:1789597147.534933:0:23350:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789597147.534936:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789597147.534949:0:23350:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c7ebb188000) 00000020:00000080:1.0:1789597147.534962:0:23350:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789597147.534967:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789597147.535054:0:23350:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789597147.535061:0:23350:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789597147.535072:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bc0432 00010000:00080000:1.0:1789597147.535108:0:23350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb5587000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.116@tcp at head 00000100:00100000:0.0:1789597147.535881:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912768 00000100:00100000:0.0:1789597147.535892:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912768 00000100:00100000:0.0:1789597147.535931:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789597147.535939:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876527984912768:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789597147.535968:0:22618:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:0.0:1789597147.535999:0:22618:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bc0439 00000004:00100000:0.0:1789597147.536015:0:22618:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789597147.536020:0:22618:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1789597147.536154:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789597147.536159:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789597147.536162:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597147.536167:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 721 00000100:00080000:0.0:1789597147.536171:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1789597147.536193:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597147.536219:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f0b100 x1876527984912896/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1789597147.536645:0:23350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1789597147.538589:0:23350:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789597147.544438:0:23350:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789597147.549000:0:23350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789597147.552648:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984912896:0@lo:38:kworker.0 00000100:00100000:3.0:1789597147.552774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.552872:0:22619:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789597147.552880:0:22619:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789597147.553624:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984912896 00000100:00100000:2.0:1789597147.553634:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984912896 00000100:00100000:3.0:1789597147.553902:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789597147.553912:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876527984912896:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789597147.554000:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876527984912896:12345-0@lo:38:kworker.0 Request processed in 88us (1225us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789597147.554007:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789597147.554204:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789597147.554213:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597147.554217:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789597147.554220:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984912896:0@lo:38:kworker.0 00000040:00080000:1.0:1789597147.554378:0:23350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789597147.554586:0:23350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789597147.555784:0:23356:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789597147.555791:0:23356:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:0.0:1789597147.556072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597147.556077:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597147.556080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597147.556083:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789597147.556325:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984913024:0@lo:400:kworker.0 00000100:00100000:3.0:1789597147.556393:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597147.557497:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984913024 00000100:00100000:0.0:1789597147.557509:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984913024 00000100:00100000:0.0:1789597147.557559:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597147.557568:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984913024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597147.557642:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984913024:12345-0@lo:400:kworker.0 Request processed in 74us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.557649:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789597147.558551:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7e85f09500 x1876527984913024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597147.558567:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984913024:0@lo:400:kworker.0 00000020:00000080:2.0:1789597147.559968:0:23350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789597147.559987:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000100:00080000:1.0:1789597147.560295:0:22618:0:(import.c:65:import_set_state_nolock()) ffff9c7eb98c5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597147.560391:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984912768:12345-0@lo:38:llog_process_th.0 Request processed in 24450us (25806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597147.560427:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789597147.560598:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789597147.560608:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789597147.560617:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789597147.560623:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789597147.560626:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9d7d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789597147.560637:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984912768:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789597147.560918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984913152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597147.560962:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:2.0:1789597147.561017:0:23350:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000100:00100000:0.0:1789597147.561137:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984913152 00000100:00100000:0.0:1789597147.561144:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984913152 00000100:00100000:0.0:1789597147.561186:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789597147.561194:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984913152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789597147.561220:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789597147.561304:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984913152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.561310:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000080:2.0:1789597147.561392:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bc0440 00000100:00080000:2.0:1789597147.561400:0:23350:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789597147.561409:0:23350:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c7eb5587000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597147.561434:0:23350:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb0c20380 x1876527984913280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789597147.561494:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984913280:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789597147.561519:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984913280 offset 0 length 520: 4 00000100:00100000:3.0:1789597147.561634:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984913152:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789597147.561830:0:23350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789597147.562025:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789597147.562031:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.562033:0:23350:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789597147.562036:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789597147.562049:0:23350:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789597147.562051:0:23350:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789597147.562052:0:23350:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789597147.562054:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789597147.562056:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.562058:0:23350:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789597147.562060:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789597147.562065:0:23350:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789597147.562068:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.562069:0:23350:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789597147.562071:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789597147.562075:0:23350:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.116@tcp to nid 0x20000c0a8ca74 (192.168.202.116@tcp) 00000020:01000000:2.0:1789597147.562094:0:23350:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789597147.562096:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789597147.562109:0:23350:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c7eb98b99c0) 00000020:00000080:2.0:1789597147.562126:0:23350:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789597147.562130:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789597147.562210:0:23350:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789597147.562217:0:23350:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789597147.562221:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x7b5398e289bc044e 00010000:00080000:2.0:1789597147.562248:0:23350:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7eb66a8800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789597147.562464:0:23350:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789597147.562534:0:23350:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789597147.562551:0:23350:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789597147.562790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597147.562795:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597147.562799:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597147.562802:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789597147.574586:0:23350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789597147.574963:0:23350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789597147.575088:0:23350:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:1.0:1789597147.575549:0:23358:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789597147.575554:0:23358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789597147.576309:0:23350:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789597147.576322:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789597147.576370:0:23350:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789597147.576407:0:23350:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bc0455 00000100:00080000:2.0:1789597147.576418:0:23350:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789597147.576433:0:23350:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7eb66a8800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597147.576485:0:23350:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb0c21f80 x1876527984913408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789597147.576513:0:23350:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789597147.576602:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789597147.576607:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.576609:0:23350:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789597147.576612:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789597147.576616:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.576617:0:23350:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789597147.576620:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789597147.576622:0:23350:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789597147.576624:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789597147.576626:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.576627:0:23350:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789597147.576630:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789597147.576632:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.576633:0:23350:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789597147.576637:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789597147.576707:0:23350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789597147.576711:0:23350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597147.576713:0:23350:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789597147.576717:0:23350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1789597147.577001:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597147.577006:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597147.577010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597147.577019:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597147.577092:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984913408:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789597147.577148:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984913408 offset 0 length 520: 4 00000020:01000000:3.0:1789597147.577538:0:23346:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789597147.577571:0:23346:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789597147.577596:0:23346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc000/0x7b5398e289bc03d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03de expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.577607:0:23346:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dc000/0x7b5398e289bc03d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc03de expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597147.577615:0:23346:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb98c4000 from 1 10000000:01000000:3.0:1789597147.577617:0:23346:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789597147.577643:0:23346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.577663:0:23346:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.577674:0:23346:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597147.577756:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597147.577795:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.577820:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597147.577997:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984913536 00000100:00100000:1.0:1789597147.578005:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984913536 00000100:00100000:1.0:1789597147.578120:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789597147.578131:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+15:23346:x1876527984913536:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597147.578144:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597147.578156:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc045c expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.578187:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc045c expref: 16 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.578198:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc045c expref: 16 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.578212:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:1.0:1789597147.578251:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+16:23346:x1876527984913536:12345-0@lo:101:mount.lustre.0 Request processed in 122us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597147.578257:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789597147.578320:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597147.578333:0:23346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.578341:0:23346:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597147.578868:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913664:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789597147.578902:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.589736:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597147.599292:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984913664 00000100:00100000:0.0:1789597147.599309:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984913664 00000100:00100000:0.0:1789597147.599374:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789597147.599384:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+16:23346:x1876527984913664:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789597147.599413:0:22608:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789597147.599441:0:22608:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789597147.599444:0:22608:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1789597147.599735:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+16:23346:x1876527984913664:12345-0@lo:256:mount.lustre.0 Request processed in 352us (20830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.599743:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789597147.605495:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913664:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789597147.606391:0:23346:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789597147.606493:0:23346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.606509:0:23346:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597147.606518:0:23346:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb98c4000 from 1 10000000:01000000:3.0:1789597147.606521:0:23346:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597147.606559:0:23346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.606567:0:23346:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.606577:0:23346:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597147.606600:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597147.606707:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.606746:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597147.606823:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984913792 00000100:00100000:1.0:1789597147.606831:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984913792 00000100:00100000:1.0:1789597147.606891:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789597147.606900:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+16:23346:x1876527984913792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597147.606914:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597147.606928:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc046a expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.606953:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc046a expref: 17 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.606964:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc046a expref: 17 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.606973:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742600, rc 0) 00000100:00100000:1.0:1789597147.607012:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984913792:12345-0@lo:101:mount.lustre.0 Request processed in 113us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597147.607020:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789597147.607078:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597147.607092:0:23346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.607101:0:23346:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789597147.611726:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1789597147.612036:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789597147.612439:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789597147.612465:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1789597147.612478:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1789597147.612491:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1789597147.612503:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1789597147.612518:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1789597147.612531:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1789597147.612544:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1789597147.612574:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789597147.612590:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1789597147.612602:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1789597147.612618:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1789597147.612623:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1789597147.612770:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597147.612965:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597147.613052:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789597147.614815:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984913920 00000100:00100000:2.0:1789597147.614830:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984913920 00000100:00100000:0.0:1789597147.617170:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789597147.617195:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984913920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597147.617368:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984913920:12345-0@lo:501:mount.lustre.0 Request processed in 176us (4531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.617376:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789597147.617493:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984913920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597147.617548:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597147.617601:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597147.617639:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.617784:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914048 00000100:00100000:3.0:1789597147.617791:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914048 00000100:00100000:3.0:1789597147.617824:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789597147.617831:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984914048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789597147.617933:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984914048:12345-0@lo:503:mount.lustre.0 Request processed in 102us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.617949:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789597147.618151:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914048:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789597147.618563:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789597147.618625:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597147.618716:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597147.618750:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.618940:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914176 00000100:00100000:3.0:1789597147.618945:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914176 00000100:00100000:3.0:1789597147.618980:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789597147.618988:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984914176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.619074:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984914176:12345-0@lo:502:mount.lustre.0 Request processed in 86us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.619082:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789597147.619261:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597147.619433:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789597147.619459:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:1.0:1789597147.619472:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:1.0:1789597147.619485:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:1.0:1789597147.619497:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:1.0:1789597147.619509:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:1.0:1789597147.619521:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:1.0:1789597147.619533:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:1.0:1789597147.619546:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789597147.619558:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:1.0:1789597147.619583:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:1.0:1789597147.619607:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597147.619643:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.619771:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914304 00000100:00100000:3.0:1789597147.619776:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914304 00000100:00100000:3.0:1789597147.619806:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789597147.619813:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984914304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.619889:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984914304:12345-0@lo:502:mount.lustre.0 Request processed in 76us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.619896:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789597147.620305:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597147.620323:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597147.620374:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1789597147.620384:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789597147.621643:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597147.621668:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.621671:0:23361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789597147.621711:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7eb98c4000 00000020:00000080:0.0:1789597147.621714:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789597147.621723:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597147.621726:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.621728:0:23361:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789597147.621730:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597147.621733:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.621734:0:23361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789597147.621737:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7eb98c4000 00000020:00000080:0.0:1789597147.621747:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789597147.621806:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597147.621810:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.621811:0:23361:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789597147.621814:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597147.621816:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.621817:0:23361:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789597147.621821:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7eb98c4000 00000020:00000080:0.0:1789597147.621823:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789597147.622032:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597147.622037:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.622050:0:23361:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789597147.622054:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597147.622057:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.622058:0:23361:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789597147.622062:0:23361:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7eb98c4000 00000020:00000080:0.0:1789597147.622064:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789597147.622088:0:23361:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597147.622091:0:23361:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597147.622092:0:23361:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789597147.622095:0:23361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1789597147.638336:0:23346:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789597147.638397:0:23346:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789597147.638421:0:23346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.638436:0:23346:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597147.638601:0:23346:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789597147.638605:0:23346:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7eb98c4000 10000000:01000000:2.0:1789597147.638608:0:23346:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7eb98c4000 10000000:01000000:2.0:1789597147.638613:0:23346:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789597147.638619:0:23346:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7eb98c4000 from 1 10000000:01000000:2.0:1789597147.638635:0:23346:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789597147.638719:0:23346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bc0478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.638729:0:23346:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bc0478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.638742:0:23346:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bc0478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597147.638766:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789597147.638840:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.638887:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914432 00000100:00100000:2.0:1789597147.638895:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914432 00000100:00100000:2.0:1789597147.638940:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789597147.638950:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:23346:x1876527984914432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597147.638963:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597147.638976:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dd800/0x7b5398e289bc047f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0478 expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.639000:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dd800/0x7b5398e289bc047f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0478 expref: 18 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.639012:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dd800/0x7b5398e289bc047f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0478 expref: 18 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.639020:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd800, rc 0) 00000100:00100000:2.0:1789597147.639071:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914432:12345-0@lo:101:mount.lustre.0 Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597147.639078:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789597147.639132:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82612540 going to sleep for 11 seconds 00000100:00100000:2.0:1789597147.639157:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597147.639173:0:23346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bc0478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc047f expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597147.639195:0:23346:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bc0478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc047f expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789597147.641646:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1789597147.642001:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789597147.646372:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1789597147.646407:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1789597147.646420:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1789597147.646432:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1789597147.646444:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1789597147.646455:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1789597147.646468:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1789597147.646482:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1789597147.646495:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1789597147.646506:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1789597147.646518:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1789597147.646532:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1789597147.646560:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1789597147.646575:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1789597147.646587:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1789597147.646599:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1789597147.646612:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1789597147.646625:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1789597147.646637:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1789597147.646649:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1789597147.646705:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1789597147.646731:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1789597147.646745:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1789597147.646760:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1789597147.646773:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1789597147.646784:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1789597147.646795:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1789597147.646807:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1789597147.646831:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1789597147.646846:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1789597147.646858:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1789597147.646871:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1789597147.646883:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1789597147.646893:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1789597147.646905:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1789597147.646918:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1789597147.646930:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1789597147.646942:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1789597147.646953:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1789597147.646965:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1789597147.646978:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1789597147.646990:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1789597147.647002:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1789597147.647016:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1789597147.647041:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1789597147.647056:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1789597147.647069:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1789597147.647083:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1789597147.649353:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1789597147.649419:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1789597147.649447:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1789597147.649453:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1789597147.649593:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597147.649696:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.649747:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83252c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.667525:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914560 00000100:00100000:3.0:1789597147.667543:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914560 00000100:00100000:3.0:1789597147.667618:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789597147.667629:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597147.667873:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914560:12345-0@lo:501:mount.lustre.0 Request processed in 245us (18194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.667881:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789597147.667997:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914560:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597147.668052:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914688:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789597147.668104:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.668146:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e83252c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.673171:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914688 00000100:00100000:3.0:1789597147.673195:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914688 00000100:00100000:3.0:1789597147.673254:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789597147.673265:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789597147.673451:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914688:12345-0@lo:503:mount.lustre.0 Request processed in 188us (5345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.673460:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789597147.673530:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789597147.674073:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789597147.674166:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.674219:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.674255:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914816 00000100:00100000:3.0:1789597147.674260:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914816 00000100:00100000:3.0:1789597147.674287:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789597147.674294:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.674366:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914816:12345-0@lo:502:mount.lustre.0 Request processed in 72us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.674374:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789597147.674419:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.674435:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789597147.674606:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1789597147.674633:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1789597147.674704:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1789597147.674723:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1789597147.674739:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1789597147.674750:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1789597147.674762:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1789597147.674776:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1789597147.674796:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1789597147.674810:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1789597147.674822:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1789597147.674833:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1789597147.674846:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1789597147.674873:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1789597147.674887:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1789597147.674900:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1789597147.674912:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1789597147.674923:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1789597147.674934:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1789597147.674946:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1789597147.674958:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1789597147.674969:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1789597147.674980:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1789597147.674991:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1789597147.675002:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1789597147.675014:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1789597147.675025:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1789597147.675036:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1789597147.675047:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1789597147.675072:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1789597147.675086:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1789597147.675097:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1789597147.675110:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1789597147.675122:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1789597147.675132:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1789597147.675155:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1789597147.675166:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1789597147.675177:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1789597147.675187:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1789597147.675198:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1789597147.675209:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1789597147.675220:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1789597147.675231:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1789597147.675241:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1789597147.675253:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1789597147.675277:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1789597147.675289:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1789597147.675301:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1789597147.675340:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914944:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.675391:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.675433:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984914944 00000100:00100000:3.0:1789597147.675438:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984914944 00000100:00100000:3.0:1789597147.675471:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789597147.675478:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.675563:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984914944:12345-0@lo:502:mount.lustre.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.675570:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789597147.675613:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.675629:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984914944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789597147.675812:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1789597147.675834:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1789597147.675853:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984915072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.675885:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.675912:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915072 00000100:00100000:3.0:1789597147.675916:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915072 00000100:00100000:3.0:1789597147.675937:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789597147.675943:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984915072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597147.676000:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984915072:12345-0@lo:502:mount.lustre.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597147.676006:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789597147.676038:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e889280c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597147.676050:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984915072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789597147.676081:0:23346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1789597147.676087:0:23346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789597147.698017:0:23366:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789597147.698034:0:23366:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c7ebb18b380) 00000020:00000080:1.0:1789597147.698058:0:23366:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789597147.698146:0:23366:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7eb98c4000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789597147.698150:0:23366:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7eb98c4000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789597147.698152:0:23366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7eb98c4000 3 00010000:00080000:1.0:1789597147.698179:0:23366:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e9dde9000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789597147.705700:0:23366:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789597147.705960:0:23366:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789597147.706004:0:23366:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789597147.706023:0:23366:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x7b5398e289bc048d 00000100:00080000:1.0:1789597147.706033:0:23366:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789597147.706046:0:23366:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c7e9dde9000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597147.706080:0:23366:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb025180 x1876527984915200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597147.706105:0:23366:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789597147.706527:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984915200:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789597147.706593:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.706716:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915200 00000100:00100000:2.0:1789597147.706724:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915200 00000100:00100000:2.0:1789597147.706760:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789597147.706768:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984915200:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789597147.706793:0:22614:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 722 last 0 00000020:00000080:2.0:1789597147.706839:0:22614:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x7b5398e289bc0494 00000004:00100000:2.0:1789597147.706853:0:22614:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789597147.706888:0:22614:0:(import.c:65:import_set_state_nolock()) ffff9c7e9dcee800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597147.706942:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876527984915200:12345-0@lo:38:llog_process_th.0 Request processed in 173us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597147.706950:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789597147.706991:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7ebb025180 x1876527984915200/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597147.707001:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789597147.707009:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789597147.707016:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789597147.707020:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789597147.707023:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9dde9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789597147.707029:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876527984915200:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789597147.709299:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597147.709311:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597147.709314:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597147.709318:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789597147.710502:0:23366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1789597147.710621:0:23346:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789597147.710707:0:23346:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789597147.710887:0:23346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bc0478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc047f expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597147.710900:0:23346:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd600/0x7b5398e289bc0478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc047f expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789597147.710991:0:23346:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789597147.710993:0:23346:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789597147.710995:0:23346:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597147.710996:0:23346:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597147.710997:0:23346:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597147.710998:0:23346:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597147.710999:0:23346:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789597147.711001:0:23346:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597147.711003:0:23346:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789597147.711007:0:23346:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789597147.711009:0:23346:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789597147.711014:0:23346:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789597147.711015:0:23346:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597147.711016:0:23346:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597147.711017:0:23346:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597147.711018:0:23346:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597147.711019:0:23346:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789597147.711020:0:23346:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597147.711020:0:23346:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789597147.711053:0:23346:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789597147.711077:0:23346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984915328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789597147.711154:0:23346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597147.711198:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915328 00000100:00100000:1.0:1789597147.711206:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915328 00000100:00100000:1.0:1789597147.711257:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789597147.711266:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:23346:x1876527984915328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789597147.711293:0:22608:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789597147.711307:0:22608:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789597147.712833:0:22593:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789597147.713007:0:23346:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699540 going to sleep for 11 seconds 20000000:01000000:2.0:1789597147.717347:0:22608:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789597147.717368:0:22608:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1789597147.717514:0:22629:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789597147.717520:0:22629:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789597147.717543:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.717563:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 18 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.717571:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc045c expref: 18 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.717577:0:22629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.717618:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc045c expref: 18 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.717661:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc045c expref: 18 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597147.717703:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984915456:0@lo:104: 00000100:00100000:3.0:1789597147.717768:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789597147.717819:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 18 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597147.717827:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 18 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597147.717835:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984915584:0@lo:104: 00000100:00100000:3.0:1789597147.717856:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.717875:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e853c8480 going to sleep for 11 seconds 00000100:00100000:0.0:1789597147.717963:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915456 00000100:00100000:0.0:1789597147.717972:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915456 00000100:00100000:0.0:1789597147.718009:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915584 00000100:00100000:0.0:1789597147.718011:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915584 00000100:00100000:0.0:1789597147.718025:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597147.718034:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:22629:x1876527984915456:12345-0@lo:104: 00010000:00010000:0.0:1789597147.718048:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718100:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789597147.718106:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:22629:x1876527984915456:12345-0@lo:104: Request processed in 74us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.718119:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597147.718137:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597147.718142:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984915584:12345-0@lo:104: 00010000:00010000:0.0:1789597147.718149:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718182:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789597147.718187:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984915584:12345-0@lo:104: Request processed in 46us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.718193:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597147.718226:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984915456:0@lo:104: 00000100:00100000:0.0:1789597147.718235:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984915584:0@lo:104: 00010000:00010000:0.0:1789597147.718253:0:22629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718269:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789597147.718274:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718281:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1789597147.718285:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718294:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789597147.718302:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789597147.718313:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789597147.718342:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718349:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789597147.718367:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718374:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc045c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0463 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718385:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597147.718388:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718393:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4000 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:0.0:1789597147.718396:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718403:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789597147.718409:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789597147.718414:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789597147.718423:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718428:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789597147.718440:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718446:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4000/0x7b5398e289bc0398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc039f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718460:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597147.718462:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597147.718464:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597147.718470:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597147.718489:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984915712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597147.718519:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597147.718542:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597147.718547:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984915840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597147.718566:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597147.718597:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915712 00000100:00100000:0.0:1789597147.718602:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915712 00010000:00010000:0.0:1789597147.718621:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc045c expref: 19 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597147.718640:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915840 00000100:00100000:0.0:1789597147.718643:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915840 00010000:00010000:0.0:1789597147.718667:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 20 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597147.718703:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597147.718709:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+20:3644:x1876527984915712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789597147.718721:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789597147.718727:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc045c expref: 20 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718746:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc045c expref: 20 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718759:0:22598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc0463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc045c expref: 20 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718771:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789597147.718799:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+19:3644:x1876527984915712:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.718805:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789597147.718818:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597147.718823:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+18:3644:x1876527984915840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789597147.718831:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789597147.718836:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 18 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718844:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 18 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718853:0:22598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742200/0x7b5398e289bc039f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc0398 expref: 18 pid: 22607 timeout: 822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718864:0:22598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718873:0:22598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789597147.718886:0:22598:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013493171s 00010000:00010000:0.0:1789597147.718897:0:22598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718904:0:22598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718910:0:22598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718917:0:22598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718922:0:22598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597147.718926:0:22598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718934:0:22598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718947:0:22598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.718955:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789597147.718976:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+17:3644:x1876527984915840:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597147.718982:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597147.719012:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984915840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789597147.719019:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984915712:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789597147.719040:0:22629:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.719056:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597147.719063:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc049b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597147.721270:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+16:23346:x1876527984915328:12345-0@lo:253:mount.lustre.0 Request processed in 9997us (10108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597147.721284:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789597147.721824:0:23346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:23346:1876527984915328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789597147.721841:0:23346:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789597147.721844:0:23346:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789597147.721846:0:23346:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789597147.721847:0:23346:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789597147.721848:0:23346:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789597147.721849:0:23346:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789597147.721851:0:23346:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789597147.721852:0:23346:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789597147.721854:0:23346:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789597147.721856:0:23346:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789597147.721872:0:23346:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1789597147.729379:0:23346:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789597147.729463:0:23373:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789597147.729468:0:23373:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789597147.730329:0:23374:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789597147.730465:0:23346:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1789597147.730860:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23375:1876527984915968:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789597147.730935:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597147.730974:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e853c8240 going to sleep for 11 seconds 00000100:00100000:2.0:1789597147.731209:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984915968 00000100:00100000:2.0:1789597147.731218:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984915968 00000040:01000000:0.0:1789597147.731611:0:23346:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789597147.731662:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789597147.736307:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597147.736332:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23375:x1876527984915968:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.736506:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23375:x1876527984915968:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 186us (5570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597147.736514:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597147.736587:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23375:1876527984915968:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789597147.736630:0:23375:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789597147.736717:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23375:1876527984916096:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.736760:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.736790:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916096 00000100:00100000:2.0:1789597147.736798:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916096 00000100:00100000:2.0:1789597147.736831:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597147.736837:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23375:x1876527984916096:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.736925:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23375:x1876527984916096:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 88us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597147.736932:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597147.736949:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836aef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597147.736961:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23375:1876527984916096:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.737021:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23375:1876527984916224:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.737057:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.737088:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916224 00000100:00100000:2.0:1789597147.737091:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916224 00000100:00100000:2.0:1789597147.737114:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789597147.737120:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23375:x1876527984916224:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.737151:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23375:x1876527984916224:12345-0@lo:900:lod0001_rec0000.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597147.737157:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789597147.737172:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae000 going to sleep for 11 seconds 00010000:00080000:2.0:1789597147.737186:0:23375:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7eb0c20e00 x1876527984916224/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789597163 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597147.737196:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23375:1876527984916224:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.737231:0:23375:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23375:1876527984916352:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.737252:0:23375:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597147.737269:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916352 00000100:00100000:2.0:1789597147.737272:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916352 00000100:00100000:2.0:1789597147.737289:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597147.737295:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23375:x1876527984916352:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789597147.737333:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23375:x1876527984916352:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 38us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597147.737338:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597147.737352:0:23375:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836aef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597147.737365:0:23375:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23375:1876527984916352:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789597147.737401:0:23375:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789597147.738875:0:23346:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789597147.738897:0:23346:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789597147.739000:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789597147.740009:0:23346:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789597147.740481:0:23374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789597147.742780:0:23374:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789597147.742873:0:23374:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1789597147.746875:0:23346:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789597147.746951:0:23346:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789597147.747152:0:23346:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789597147.752328:0:23375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789597147.752424:0:23375:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789597147.752429:0:23375:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:1.0:1789597147.752464:0:23346:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1789597147.758864:0:23346:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789597147.766117:0:23346:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789597147.766169:0:23346:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffc0dc4193f988 00100000:10000000:1.0:1789597147.766189:0:23346:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789597147.769942:0:23346:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789597147.769979:0:23346:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789597147.770002:0:23346:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789597147.770033:0:23346:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789597147.770676:0:23346:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789597147.772091:0:23346:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789597147.773268:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:3.0:1789597148.349523:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789597148.734366:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789597148.801986:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:0.0:1789597149.374254:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789597149.452855:0:22610:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789597149.452866:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb98c4000 from 12 10000000:01000000:1.0:1789597149.452874:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789597149.452927:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.452941:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.452954:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597149.452986:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789597149.453153:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597149.453261:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916480 00000100:00100000:1.0:1789597149.453270:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916480 00000100:00100000:1.0:1789597149.453322:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789597149.453403:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+16:22610:x1876527984916480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597149.453494:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597149.453511:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc04a2 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.453538:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.454149:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 17 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.454224:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742400, rc 0) 00000100:00100000:1.0:1789597149.454285:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984916480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 884us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597149.454293:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789597149.454547:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789597149.454657:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597149.454695:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.454705:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597149.454775:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916608:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789597149.454819:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597149.454837:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb480 going to sleep for 11 seconds 00000100:00100000:2.0:1789597149.454945:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916608 00000100:00100000:2.0:1789597149.454952:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916608 00000100:00100000:2.0:1789597149.454995:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789597149.455004:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984916608:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789597149.455022:0:22608:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789597149.455049:0:22608:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789597149.455053:0:22608:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789597149.455129:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984916608:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597149.455136:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789597149.457148:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916608:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789597149.457492:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789597149.457503:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.457515:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597149.457537:0:22610:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789597149.457540:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d83162800 from 12 10000000:01000000:1.0:1789597149.457542:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789597149.458150:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.458226:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.458237:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597149.458261:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789597149.458915:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597149.458974:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789597149.459502:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916736 00000100:00100000:0.0:1789597149.459515:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916736 00000100:00100000:1.0:1789597149.460784:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789597149.460801:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984916736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597149.460820:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597149.460837:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc04b0 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.460866:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 18 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.460879:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 18 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.460888:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:1.0:1789597149.460997:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984916736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597149.461005:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789597149.461238:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597149.461259:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597149.461269:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597149.461666:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789597149.461746:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597149.461792:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789597149.462791:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916864 00000100:00100000:1.0:1789597149.462806:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916864 00000100:00100000:1.0:1789597149.462845:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789597149.462853:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984916864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789597149.462878:0:22607:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789597149.462902:0:22607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789597149.462905:0:22607:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789597149.464059:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984916864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1186us (2293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597149.464073:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789597149.464156:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984916864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789597149.464398:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789597149.464522:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597149.464533:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789597149.757374:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789597149.824065:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:3.0:1789597150.401249:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597150.847339:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:0.0:1789597151.420908:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597151.868849:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00010000:00010000:1.0:1789597152.450064:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597152.702012:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984916992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597152.702086:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597152.702309:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984916992 00000100:00100000:0.0:1789597152.702326:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984916992 00000100:00100000:0.0:1789597152.702385:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789597152.702396:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984916992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789597152.702432:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789597152.702490:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984916992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597152.702497:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789597152.702595:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984916992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597152.895935:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 0 seconds 00000100:00080000:1.0:1789597153.213793:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789597153.213800:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789597153.213805:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597153.213829:0:479:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c7eb9b5f800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597153.213853:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb027480 x1876527984917248/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597153.213872:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597153.213875:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597153.213878:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597153.213882:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597153.213907:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597153.213910:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597153.213913:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597153.213915:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597153.213947:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984917248:0@lo:38:kworker.0 00000100:00100000:1.0:1789597153.214030:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597153.214100:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984917376:0@lo:400:kworker.0 00000100:00100000:1.0:1789597153.214128:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597153.214147:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597153.214152:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984917504:0@lo:400:kworker.0 00000100:00100000:1.0:1789597153.214177:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597153.214209:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984917248 00000100:00100000:1.0:1789597153.214216:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984917248 00000100:00100000:1.0:1789597153.214244:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984917504 00000100:00100000:1.0:1789597153.214247:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984917504 00000100:00100000:1.0:1789597153.214272:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789597153.214279:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876527984917248:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789597153.214312:0:22619:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:1.0:1789597153.214347:0:22619:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bc04be 00000004:00100000:1.0:1789597153.214363:0:22619:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789597153.214368:0:22619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1789597153.214438:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984917376 00000100:00100000:1.0:1789597153.214442:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984917376 00000100:00100000:1.0:1789597153.214470:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789597153.214477:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984917376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597153.214538:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984917376:12345-0@lo:400:kworker.0 Request processed in 62us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597153.214545:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789597153.214579:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597153.214586:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984917504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597153.214624:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984917504:12345-0@lo:400:kworker.0 Request processed in 39us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597153.214629:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597153.214674:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984917504:0@lo:400:kworker.0 00010000:00080000:1.0:1789597153.214709:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb027b80 x1876527984917376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597153.214720:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984917376:0@lo:400:kworker.0 00000100:00100000:2.0:1789597153.214978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984917120:0@lo:400:kworker.0 00000100:00100000:2.0:1789597153.215025:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597153.215059:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597153.215065:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984917632:0@lo:400:kworker.0 00000100:00100000:2.0:1789597153.215088:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597153.215112:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984917632 00000100:00100000:2.0:1789597153.215116:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984917632 00000100:00100000:2.0:1789597153.215145:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597153.215151:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984917632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597153.215181:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984917632:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597153.215186:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789597153.215208:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb024e00 x1876527984917632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597153.215217:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984917632:0@lo:400:kworker.0 00000100:00100000:1.0:1789597153.215347:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984917120 00000100:00100000:1.0:1789597153.215351:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984917120 00000100:00100000:1.0:1789597153.215381:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789597153.215387:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:3647:x1876527984917120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597153.215430:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:3647:x1876527984917120:12345-0@lo:400:kworker.0 Request processed in 43us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597153.215436:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789597153.215512:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984917120:0@lo:400:kworker.0 00000100:00080000:1.0:1789597153.231505:0:22619:0:(import.c:65:import_set_state_nolock()) ffff9c7e9dd25800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597153.231629:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984917248:12345-0@lo:38:kworker.0 Request processed in 17346us (17596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597153.231641:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789597153.231958:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789597153.231984:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789597153.231990:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789597153.231993:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb9b5f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789597153.232148:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fd4a9106): req@ffff9c7eb0c22300 x1876527984909824/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597153.232211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984917248:0@lo:38:kworker.0 00000100:00100000:0.0:1789597153.232378:0:22654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597153.232401:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789597153.232408:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789597153.232415:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984917760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597153.232442:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597153.236041:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984909824 00000100:00100000:0.0:1789597153.236060:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984909824 00000100:00100000:0.0:1789597153.236415:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984917760 00000100:00100000:0.0:1789597153.236420:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984917760 00000100:00100000:0.0:1789597153.236440:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789597153.236450:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22654:x1876527984909824:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789597153.236488:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789597153.236501:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876527984917760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789597153.236537:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597153.236596:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22654:x1876527984909824:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 147us (4218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597153.236615:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789597153.236649:0:22654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22654:1876527984909824:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1789597153.236723:0:22654:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789597153.236767:0:22654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22654:1876527984917888:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789597153.236806:0:22654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597153.236834:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789597153.236843:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984917888 00000100:00100000:2.0:1789597153.236846:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984917888 00000100:00100000:2.0:1789597153.236858:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789597153.236862:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22654:x1876527984917888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789597153.236943:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22654:x1876527984917888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597153.236948:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789597153.236965:0:22654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22654:1876527984917888:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789597153.237030:0:22654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22654:1876527984918016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789597153.237047:0:22654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597153.237056:0:22654:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b4c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789597153.237064:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984918016 00000100:00100000:2.0:1789597153.237066:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984918016 00000100:00100000:2.0:1789597153.237076:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597153.237079:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22654:x1876527984918016:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789597153.237106:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22654:x1876527984918016:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 26us (59us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597153.237110:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597153.237124:0:22654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c22300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22654:1876527984918016:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789597153.237153:0:22654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789597153.238773:0:22654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789597153.238908:0:22654:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:2.0:1789597153.238912:0:22654:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1789597153.239648:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984917760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3146us (7199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597153.239660:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597153.239982:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984917760:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1789597153.455326:0:23617:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789597153.493334:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789597153.920180:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789597154.493222:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789597154.680773:0:23669:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597154.680995:0:23669:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789597155.520587:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789597155.895150:0:23720:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597155.895443:0:23720:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789597156.284941:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597141/real 1789597141] req@ffff9c7eb4589880 x1876527984910976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597156 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597156.284980:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb4589880 x1876527984910976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597156 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597156.284991:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597141/real 1789597141] req@ffff9c7eb4589c00 x1876527984911104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597156 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597156.285004:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb4589c00 x1876527984911104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597156 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789597156.285027:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e294000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597156.285056:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789597156.285060:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984910976:0@lo:8:kworker.0 00000100:00080000:3.0:1789597156.285066:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597156.285092:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789597156.285095:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984911104:0@lo:8:kworker.0 00000100:00080000:1.0:1789597156.285263:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597156.285268:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789597156.285271:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e294000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597156.285277:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 716 00000100:00080000:1.0:1789597156.285283:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789597156.285301:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7e9e294000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597156.285322:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb024a80 x1876527984918400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597156.285341:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597156.285345:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789597156.285347:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597156.285350:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 716 00000100:00080000:1.0:1789597156.285354:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789597156.285359:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7e867d7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597156.285390:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb025500 x1876527984918528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597156.285428:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597156.285432:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597156.285434:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597156.285437:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597156.285465:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984918656:0@lo:400:kworker.0 00000100:00100000:1.0:1789597156.285536:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597156.285582:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789597156.285589:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984918784:0@lo:400:kworker.0 00000100:00100000:1.0:1789597156.285614:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597156.285651:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984918656 00000100:00100000:1.0:1789597156.285660:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984918656 00000100:00100000:1.0:1789597156.285746:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789597156.285755:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984918656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597156.285808:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984918656:12345-0@lo:400:kworker.0 Request processed in 54us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597156.285815:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789597156.285839:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984918784 00000100:00100000:1.0:1789597156.285843:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984918784 00000100:00100000:1.0:1789597156.285866:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789597156.285872:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984918784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597156.285905:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984918784:12345-0@lo:400:kworker.0 Request processed in 33us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597156.285911:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789597156.285960:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984918784:0@lo:400:kworker.0 00010000:00080000:1.0:1789597156.285971:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb025c00 x1876527984918656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597156.285981:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984918656:0@lo:400:kworker.0 00000100:00100000:2.0:1789597156.286145:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984918144:0@lo:400:kworker.0 00000100:00100000:2.0:1789597156.286184:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597156.286221:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984918912:0@lo:400:kworker.0 00000100:00100000:2.0:1789597156.286243:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597156.286261:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597156.286276:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984918272:0@lo:400:kworker.0 00000100:00100000:2.0:1789597156.286300:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597156.286388:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984918272 00000100:00100000:3.0:1789597156.286393:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984918272 00000100:00100000:3.0:1789597156.286430:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789597156.286437:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984918272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597156.286482:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876527984918272:12345-0@lo:400:kworker.0 Request processed in 46us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597156.286488:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789597156.286514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984918272:0@lo:400:kworker.0 00000100:00100000:3.0:1789597156.286534:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984918400:0@lo:8:kworker.0 00000400:00000100:3.0:1789597156.286560:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984918400 offset 0 length 520: 4 00000100:00100000:3.0:1789597156.286585:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984918528:0@lo:8:kworker.0 00000400:00000100:3.0:1789597156.286605:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984918528 offset 0 length 520: 4 00000100:00100000:1.0:1789597156.286785:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984918144 00000100:00100000:1.0:1789597156.286790:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984918144 00000100:00100000:1.0:1789597156.286827:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789597156.286836:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:3644:x1876527984918144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597156.286885:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:3644:x1876527984918144:12345-0@lo:400:kworker.0 Request processed in 51us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597156.286892:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789597156.286921:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984918912 00000100:00100000:1.0:1789597156.286925:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984918912 00000100:00100000:1.0:1789597156.286949:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789597156.286956:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984918912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597156.286984:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984918912:12345-0@lo:400:kworker.0 Request processed in 29us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597156.286990:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789597156.287172:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984918144:0@lo:400:kworker.0 00010000:00080000:3.0:1789597156.287187:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb027480 x1876527984918912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597156.287199:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984918912:0@lo:400:kworker.0 00010000:00010000:2.0:1789597156.541606:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789597157.310948:0:23768:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3d2685b0 20000000:00000080:3.0:1789597157.310966:0:23768:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7e9dc99400 uarg=0000000000000000 20000000:01000000:3.0:1789597157.311008:0:23768:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789597157.311015:0:23768:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789597157.311020:0:23768:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000100:00100000:1.0:1789597157.311202:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597147/real 1789597147] req@ffff9c7eb0c21f80 x1876527984913408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597157.311233:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb0c21f80 x1876527984913408/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597157.311244:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597147/real 1789597147] req@ffff9c7eb0c20380 x1876527984913280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597157 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597157.311272:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7eb0c20380 x1876527984913280/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597157 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789597157.311290:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597157.311543:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789597157.311548:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984913408:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789597157.311554:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5587000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000040:00080000:3.0:1789597157.314410:0:23769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789597157.314498:0:23768:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 00000100:00080000:0.0:1789597157.316265:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597157.316271:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597157.316274:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597157.316277:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597157.316293:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597157.316297:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789597157.316312:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5587000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597157.316319:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 722 00000100:00080000:0.0:1789597157.316325:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789597157.316337:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c7eb5587000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597157.316363:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f08700 x1876527984919552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789597157.316375:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597157.316377:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789597157.316379:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597157.316382:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 722 00000100:00080000:0.0:1789597157.316385:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789597157.316389:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7eb66a8800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597157.316399:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f09f80 x1876527984919680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789597157.316436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984919424:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.316499:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597157.316536:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789597157.316541:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984919040:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.316583:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597157.316609:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984919808:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.316636:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597157.316663:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984919168:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.316707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597157.316726:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789597157.316732:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984919296:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.316762:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597157.316795:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984919424 00000100:00100000:0.0:1789597157.316803:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984919424 00000100:00100000:0.0:1789597157.316843:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984919168 00000100:00100000:0.0:1789597157.316847:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984919168 00000100:00100000:0.0:1789597157.316865:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789597157.316874:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984919424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.316926:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984919424:12345-0@lo:400:kworker.0 Request processed in 52us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597157.316933:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789597157.316950:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789597157.316956:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984919168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.316988:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984919168:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597157.316994:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789597157.317011:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984919040 00000100:00100000:0.0:1789597157.317014:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984919040 00000100:00100000:0.0:1789597157.317037:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789597157.317042:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:3644:x1876527984919040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.317067:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:3644:x1876527984919040:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597157.317072:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789597157.317094:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984919808 00000100:00100000:0.0:1789597157.317097:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984919808 00000100:00100000:0.0:1789597157.317117:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984919296 00000100:00100000:0.0:1789597157.317119:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984919296 00000100:00100000:0.0:1789597157.317129:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789597157.317135:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984919808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.317166:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984919808:12345-0@lo:400:kworker.0 Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597157.317172:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789597157.317181:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789597157.317186:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984919296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.317204:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984919296:12345-0@lo:400:kworker.0 Request processed in 19us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597157.317209:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789597157.317250:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7e85f09180 x1876527984919296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597157.317264:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984919296:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.317272:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984919168:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.317295:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984919040:0@lo:400:kworker.0 00010000:00080000:0.0:1789597157.317303:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7e85f0a300 x1876527984919808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597157.317311:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984919808:0@lo:400:kworker.0 00000100:00100000:0.0:1789597157.317319:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984919424:0@lo:400:kworker.0 00000100:00080000:1.0:1789597157.321737:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789597157.321749:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984913280:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789597157.321790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984919552:0@lo:8:kworker.0 00000400:00000100:1.0:1789597157.321848:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984919552 offset 0 length 520: 4 00000100:00100000:1.0:1789597157.321889:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984919680:0@lo:8:kworker.0 00000400:00000100:1.0:1789597157.321908:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527984919680 offset 0 length 520: 4 10000000:01000000:3.0:1789597157.323027:0:23768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789597157.323053:0:23768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597157.323070:0:23768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 17 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597157.323079:0:23768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc046a expref: 17 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597157.323235:0:23768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597157.323585:0:23768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc046a expref: 17 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597157.323603:0:23768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc046a expref: 17 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597157.323616:0:23768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23768:1876527984919936:0@lo:104: 00000100:00100000:1.0:1789597157.323664:0:23768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789597157.323776:0:23768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 17 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597157.323784:0:23768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 17 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597157.323804:0:23768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23768:1876527984920064:0@lo:104: 00000100:00100000:1.0:1789597157.323827:0:23768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789597157.324806:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597157.324814:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597157.324817:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597157.324821:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597157.324847:0:23768:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e853c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789597157.324903:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984919936 00000100:00100000:2.0:1789597157.324911:0:22596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984919936 00000100:00100000:2.0:1789597157.324951:0:22596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920064 00000100:00100000:2.0:1789597157.324954:0:22596:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920064 00000100:00100000:2.0:1789597157.324971:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789597157.324979:0:22596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:980ee822-f655-4df0-a283-f316bd6c264b+4:23768:x1876527984919936:12345-0@lo:104: 00010000:00010000:2.0:1789597157.324994:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325122:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789597157.325129:0:22596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:980ee822-f655-4df0-a283-f316bd6c264b+4:23768:x1876527984919936:12345-0@lo:104: Request processed in 150us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597157.325137:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789597157.325156:0:22596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597157.325162:0:22596:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:980ee822-f655-4df0-a283-f316bd6c264b+3:23768:x1876527984920064:12345-0@lo:104: 00010000:00010000:2.0:1789597157.325170:0:22596:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325205:0:22596:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789597157.325211:0:22596:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:980ee822-f655-4df0-a283-f316bd6c264b+3:23768:x1876527984920064:12345-0@lo:104: Request processed in 49us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597157.325217:0:22596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789597157.325232:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597157.325238:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325260:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597157.325264:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325273:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597157.325280:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597157.325286:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789597157.325318:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325324:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597157.325349:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325356:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc046a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0471 expref: -99 pid: 23346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325369:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597157.325372:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325378:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dca00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597157.325380:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325397:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597157.325403:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597157.325408:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789597157.325421:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325426:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597157.325432:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325439:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc0367 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc036e expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325452:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597157.325454:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597157.325456:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597157.325478:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984920320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597157.325512:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597157.325533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597157.325538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984920192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597157.325556:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597157.325606:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920320 00000100:00100000:2.0:1789597157.325610:0:22599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920320 00010000:00010000:2.0:1789597157.325627:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 18 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597157.325658:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920192 00000100:00100000:2.0:1789597157.325662:0:22599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920192 00010000:00010000:2.0:1789597157.325674:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc046a expref: 19 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597157.325714:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789597157.325721:0:22599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:980ee822-f655-4df0-a283-f316bd6c264b+19:3647:x1876527984920320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597157.325731:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597157.325737:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 19 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325746:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 19 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325763:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597157.325793:0:22599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:980ee822-f655-4df0-a283-f316bd6c264b+19:3647:x1876527984920320:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597157.325799:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789597157.325811:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597157.325818:0:22599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:980ee822-f655-4df0-a283-f316bd6c264b+18:3647:x1876527984920192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597157.325825:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597157.325829:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc046a expref: 18 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325838:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc046a expref: 18 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325849:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325865:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325882:0:22599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325889:0:22599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325896:0:22599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325902:0:22599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325907:0:22599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597157.325910:0:22599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325918:0:22599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325927:0:22599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597157.325936:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597157.325960:0:22599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:980ee822-f655-4df0-a283-f316bd6c264b+18:3647:x1876527984920192:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597157.325966:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597157.326005:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984920192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597157.326024:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984920320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597157.326173:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597157.326622:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742600/0x7b5398e289bc0471 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc046a expref: 17 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597157.326637:0:23768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23768:1876527984919936:0@lo:104: 00010000:00010000:1.0:1789597157.326646:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742a00/0x7b5398e289bc036e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc0367 expref: 16 pid: 22608 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597157.326654:0:23768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23768:1876527984920064:0@lo:104: 00010000:00010000:1.0:1789597157.326674:0:23768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597157.326707:0:23768:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597157.326712:0:23768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597157.326717:0:23768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc04c5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597157.572787:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597157.820976:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789597157.826924:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984920448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597157.826998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597157.827255:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920448 00000100:00100000:2.0:1789597157.827266:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920448 00000100:00100000:2.0:1789597157.827336:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789597157.827347:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984920448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597157.827391:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789597157.827448:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984920448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597157.827454:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789597157.827500:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984920448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597158.333878:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984920576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789597158.333979:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597158.334083:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920576 00000100:00100000:3.0:1789597158.334096:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920576 00000100:00100000:3.0:1789597158.334155:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789597158.334165:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984920576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789597158.334205:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789597158.340263:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984920576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6088us (6272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597158.340280:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789597158.340589:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984920576:0@lo:41:osp-pre-1-0.0 10000000:01000000:3.0:1789597158.525792:0:22610:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789597158.525800:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb98c4000 from 13 10000000:01000000:3.0:1789597158.525805:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597158.525863:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.525884:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.525897:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597158.525926:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984920704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.525998:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597158.526053:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e2006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597158.527399:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920704 00000100:00100000:0.0:1789597158.527414:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920704 00000100:00100000:0.0:1789597158.527482:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789597158.527493:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+16:22610:x1876527984920704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597158.527511:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597158.527530:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc04cc expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597158.527579:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 17 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597158.527591:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 17 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597158.527602:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4a00, rc 0) 00000100:00100000:0.0:1789597158.527719:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984920704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597158.527727:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789597158.529757:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984920704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597158.529785:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597158.529798:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597158.529880:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984920832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789597158.529932:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597158.529968:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb9b7ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789597158.530106:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920832 00000100:00100000:0.0:1789597158.530112:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920832 00000100:00100000:0.0:1789597158.530155:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789597158.530164:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984920832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597158.530288:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984920832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597158.530295:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789597158.530362:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984920832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.530391:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984920960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.530468:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597158.530489:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789597158.530503:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984920960 00000100:00100000:3.0:1789597158.530507:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984920960 00000100:00100000:3.0:1789597158.530534:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789597158.530541:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984920960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.530644:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984920960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597158.530650:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789597158.530712:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984920960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789597158.531409:0:23821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789597158.531486:0:22610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789597158.531533:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789597158.531543:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.531605:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597158.531616:0:22610:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789597158.531619:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d83162800 from 13 10000000:01000000:3.0:1789597158.531622:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597158.531651:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.531659:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.531668:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597158.531709:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984921088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.531755:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597158.531810:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200300 going to sleep for 11 seconds 00000100:00100000:3.0:1789597158.531830:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921088 00000100:00100000:3.0:1789597158.531836:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921088 00000100:00100000:3.0:1789597158.531868:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789597158.531875:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+17:22610:x1876527984921088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597158.531886:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597158.531900:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc04da expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.531922:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc04da expref: 18 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.531943:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04da expref: 18 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.531953:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031e00, rc 0) 00000100:00100000:3.0:1789597158.531987:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984921088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597158.531993:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789597158.532033:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984921088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597158.532045:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597158.532054:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597158.532100:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984921216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.532126:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597158.532140:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200300 going to sleep for 11 seconds 00000100:00100000:3.0:1789597158.532150:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921216 00000100:00100000:3.0:1789597158.532153:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921216 00000100:00100000:3.0:1789597158.532176:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789597158.532181:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984921216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.532275:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984921216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597158.532283:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789597158.532313:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984921216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.532345:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984921344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.532382:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597158.532395:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e200300 going to sleep for 11 seconds 00000100:00100000:3.0:1789597158.532405:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921344 00000100:00100000:3.0:1789597158.532408:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921344 00000100:00100000:3.0:1789597158.532429:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789597158.532435:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984921344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597158.532502:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:22610:x1876527984921344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597158.532509:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789597158.532547:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984921344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789597158.557835:0:23822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789597158.558058:0:22610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789597158.558099:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789597158.558114:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597158.558128:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597158.597289:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789597159.363777:0:23347:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789597159.626756:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789597160.000625:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789597160.636958:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597161.667231:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789597162.430785:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597162.430792:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597162.430796:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597162.430799:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789597162.430816:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984921600:0@lo:400:kworker.0 00000100:00080000:1.0:1789597162.430827:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597162.430831:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597162.430834:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597162.430838:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789597162.430897:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597162.431026:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789597162.431033:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984921472:0@lo:400:kworker.0 00000100:00100000:3.0:1789597162.431073:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597162.431103:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984921984:0@lo:400:kworker.0 00000100:00100000:3.0:1789597162.431128:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597162.431157:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921472 00000100:00100000:3.0:1789597162.431165:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921472 00000100:00100000:3.0:1789597162.431215:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789597162.431224:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:3647:x1876527984921472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597162.431279:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+18:3647:x1876527984921472:12345-0@lo:400:kworker.0 Request processed in 55us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597162.431510:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921600 00000100:00100000:1.0:1789597162.431525:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921600 00000100:00100000:1.0:1789597162.431561:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789597162.431569:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984921600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597162.431613:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984921600:12345-0@lo:400:kworker.0 Request processed in 45us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597162.431620:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789597162.431730:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984921472:0@lo:400:kworker.0 00000100:00100000:1.0:1789597162.431745:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984921600:0@lo:400:kworker.0 00000100:00100000:0.0:1789597162.432380:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921984 00000100:00100000:0.0:1789597162.432388:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921984 00000100:00100000:0.0:1789597162.432450:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789597162.432458:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984921984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597162.432511:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984921984:12345-0@lo:400:kworker.0 Request processed in 54us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597162.432525:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597162.432719:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984921728:0@lo:400:kworker.0 00000100:00100000:2.0:1789597162.432760:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597162.432787:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597162.432792:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984921856:0@lo:400:kworker.0 00000100:00100000:2.0:1789597162.432814:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597162.432843:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921856 00000100:00100000:2.0:1789597162.432847:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921856 00000100:00100000:2.0:1789597162.432871:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789597162.432877:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984921856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597162.432913:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984921856:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597162.432919:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789597162.432951:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984921856:0@lo:400:kworker.0 00000100:00100000:0.0:1789597162.434384:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984921728 00000100:00100000:0.0:1789597162.434404:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984921728 00000100:00100000:0.0:1789597162.434451:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789597162.434460:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984921728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597162.434547:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984921728:12345-0@lo:400:kworker.0 Request processed in 88us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597162.434554:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789597162.434604:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb026680 x1876527984921728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597162.434619:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984921728:0@lo:400:kworker.0 00000100:00100000:3.0:1789597162.434627:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1789597162.439490:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb027480 x1876527984921984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597162.439541:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984921984:0@lo:400:kworker.0 00010000:00010000:2.0:1789597162.697910:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597162.942060:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984922112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597162.942147:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597162.952665:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984922112 00000100:00100000:2.0:1789597162.952692:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984922112 00000100:00100000:2.0:1789597162.957483:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597162.957497:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984922112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597162.957544:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789597162.957648:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984922112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (15501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597162.957655:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597162.957726:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984922112:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789597163.135310:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789597163.453219:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789597163.453241:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984922240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597163.453306:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597163.453346:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984922240 00000100:00100000:0.0:1789597163.453353:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984922240 00000100:00100000:0.0:1789597163.453395:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789597163.453403:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984922240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789597163.453437:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597163.453479:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984922240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597163.453499:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789597163.453560:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984922240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789597163.709038:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597164.738006:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789597165.312584:0:24116:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789597165.312589:0:24116:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789597165.312591:0:24116:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789597165.312949:0:24116:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7e9dfc1800 00000020:01000004:0.0:1789597165.312972:0:24116:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789597165.312987:0:24116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789597165.313004:0:24116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c7e88948000) 00000020:00000080:0.0:1789597165.313175:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789597165.432857:0:24116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789597165.444094:0:24116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789597165.444604:0:24116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789597165.444968:0:24116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789597165.445498:0:24116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789597165.445778:0:24116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789597165.446112:0:24116:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1789597165.455218:0:24116:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789597165.457296:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789597165.457312:0:24116:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789597165.457334:0:24116:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7b5398e289bc04ef 00000020:01000004:2.0:1789597165.457389:0:24116:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789597165.457414:0:24116:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789597165.457418:0:24116:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789597165.457424:0:24116:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789597165.457429:0:24116:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789597165.457444:0:24116:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c7eb98bb380) 00000020:00000080:2.0:1789597165.457472:0:24116:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789597165.469596:0:24116:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789597165.470970:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789597165.470978:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789597165.471917:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789597165.471927:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789597165.474404:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789597165.474420:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789597165.478271:0:24116:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789597165.478482:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789597165.478504:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789597165.480854:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789597165.480868:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789597165.507406:0:24116:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789597165.508161:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789597165.508170:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789597165.513610:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789597165.513627:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789597165.515131:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789597165.515142:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789597165.517577:0:24116:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789597165.517816:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789597165.517823:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789597165.519665:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789597165.519702:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789597165.587383:0:24116:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789597165.588145:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789597165.588154:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789597165.590187:0:24116:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789597165.590202:0:24116:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789597165.591373:0:24116:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789597165.591408:0:24116:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789597165.591415:0:24116:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789597165.606371:0:24116:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789597165.606416:0:24116:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.116@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789597165.606421:0:24116:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789597165.606423:0:24116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789597165.606424:0:24116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597165.606425:0:24116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597165.606426:0:24116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597165.606427:0:24116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597165.606429:0:24116:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789597165.606430:0:24116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597165.606431:0:24116:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789597165.606435:0:24116:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789597165.606438:0:24116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789597165.606439:0:24116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789597165.606440:0:24116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597165.606441:0:24116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597165.606442:0:24116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597165.606443:0:24116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597165.606444:0:24116:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789597165.606445:0:24116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597165.606452:0:24116:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789597165.606507:0:24116:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789597165.606530:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922368:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789597165.607129:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.607209:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1789597165.607250:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984922368 00000100:00100000:0.0:1789597165.607258:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984922368 00000100:00100000:0.0:1789597165.607361:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789597165.607372:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:24116:x1876527984922368:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789597165.607418:0:22607:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789597165.607422:0:22607:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789597165.607427:0:22607:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789597165.607731:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+18:24116:x1876527984922368:12345-0@lo:253:mount.lustre.0 Request processed in 362us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597165.607753:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789597165.607848:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922368:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789597165.607858:0:24116:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789597165.607861:0:24116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789597165.607863:0:24116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789597165.607864:0:24116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597165.607865:0:24116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597165.607866:0:24116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597165.607867:0:24116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597165.607868:0:24116:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789597165.607870:0:24116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597165.607871:0:24116:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789597165.607889:0:24116:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7e9dfc1800 from lustre-OST0000 10000000:01000000:2.0:1789597165.607915:0:24116:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789597165.607918:0:24116:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789597165.607927:0:24116:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7ebbcb0000 local copy 00010000:00010000:2.0:1789597165.607938:0:24116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597165.608034:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597165.608062:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.608522:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789597165.608696:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984922496 00000100:00100000:1.0:1789597165.608702:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984922496 00000100:00100000:1.0:1789597165.608730:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789597165.608745:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:24116:x1876527984922496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597165.608817:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:24116:x1876527984922496:12345-0@lo:501:mount.lustre.0 Request processed in 81us (755us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789597165.608824:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789597165.608963:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922496:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789597165.608975:0:24116:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789597165.608991:0:24116:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789597165.608997:0:24116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.609024:0:24116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597165.609055:0:24116:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7e9dfc1800 10000000:01000000:2.0:1789597165.609059:0:24116:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789597165.609065:0:24116:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789597165.609067:0:24116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789597165.609072:0:24116:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789597165.609075:0:24116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789597165.609098:0:24116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bc04fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.609105:0:24116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bc04fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.609115:0:24116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bc04fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597165.609127:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789597165.609153:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.609168:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789597165.609348:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984922624 00000100:00100000:1.0:1789597165.609353:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984922624 00000100:00100000:1.0:1789597165.609379:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789597165.609385:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+18:24116:x1876527984922624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597165.609394:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597165.609405:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d83743200/0x7b5398e289bc0504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc04fd expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.609426:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d83743200/0x7b5398e289bc0504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc04fd expref: 19 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.609436:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d83743200/0x7b5398e289bc0504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04fd expref: 19 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.609444:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743200, rc 0) 00000100:00100000:1.0:1789597165.609476:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984922624:12345-0@lo:101:mount.lustre.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.609482:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789597165.609562:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597165.609580:0:24116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bc04fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0504 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.609590:0:24116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bc04fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0504 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789597165.611408:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1789597165.613232:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789597165.618345:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789597165.618409:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789597165.618425:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789597165.618439:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789597165.618456:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789597165.618469:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789597165.618481:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789597165.618508:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789597165.618523:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1789597165.618537:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1789597165.618880:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1789597165.618900:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1789597165.618930:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1789597165.618936:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1789597165.619191:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597165.619651:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.619796:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1789597165.620080:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984922752 00000100:00100000:1.0:1789597165.620089:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984922752 00000100:00100000:1.0:1789597165.620192:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789597165.620204:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984922752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597165.620379:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984922752:12345-0@lo:501:mount.lustre.0 Request processed in 177us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.620386:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789597165.620462:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597165.620514:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922880:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789597165.620583:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.620910:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789597165.621078:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984922880 00000100:00100000:0.0:1789597165.621084:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984922880 00000100:00100000:0.0:1789597165.621114:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789597165.621121:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984922880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597165.622088:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984922880:12345-0@lo:503:mount.lustre.0 Request processed in 963us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597165.622098:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789597165.622259:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984922880:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789597165.622804:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789597165.622890:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923008:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597165.622957:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.622988:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789597165.623385:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923008 00000100:00100000:0.0:1789597165.623392:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923008 00000100:00100000:0.0:1789597165.623430:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789597165.623438:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984923008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789597165.624253:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984923008:12345-0@lo:502:mount.lustre.0 Request processed in 812us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597165.624262:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789597165.624365:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923008:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789597165.624808:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789597165.624841:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789597165.624857:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789597165.624871:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789597165.624885:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789597165.624900:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789597165.624914:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789597165.624929:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789597165.625121:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789597165.625144:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789597165.625155:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789597165.625167:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789597165.625202:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923136:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597165.625260:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.625293:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789597165.625369:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923136 00000100:00100000:0.0:1789597165.625375:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923136 00000100:00100000:0.0:1789597165.625412:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789597165.625421:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984923136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789597165.625556:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984923136:12345-0@lo:502:mount.lustre.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597165.625564:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789597165.625910:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789597165.626093:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1789597165.626105:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789597165.627219:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789597165.627229:0:24133:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789597165.627236:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597165.627239:0:24133:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789597165.627253:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789597165.627270:0:24133:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c7e889499c0) 00000020:00000080:0.0:1789597165.627298:0:24133:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789597165.627304:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789597165.627417:0:24133:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7e9dfc1800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789597165.627426:0:24133:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789597165.627434:0:24133:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7b5398e289bc0512 00010000:00010000:0.0:1789597165.637314:0:24133:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789597165.639869:0:24133:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1789597165.643255:0:24133:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1789597165.645274:0:24133:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789597165.645285:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597165.645291:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597165.645293:0:24133:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789597165.645297:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789597165.645300:0:24133:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1789597165.645301:0:24133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789597165.645303:0:24133:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789597165.645305:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789597165.645307:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597165.645308:0:24133:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789597165.645311:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597165.645313:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597165.645314:0:24133:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789597165.645317:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789597165.645319:0:24133:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789597165.645321:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597165.645323:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597165.645324:0:24133:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789597165.645326:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789597165.645328:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597165.645329:0:24133:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789597165.645332:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789597165.645374:0:24133:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789597165.645384:0:24133:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789597165.645385:0:24133:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789597165.645389:0:24133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1789597165.645855:0:24116:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789597165.645900:0:24116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789597165.645925:0:24116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bc04fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0504 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.645937:0:24116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dd000/0x7b5398e289bc04fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0504 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597165.645968:0:24116:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e9dfc1800 from 1 10000000:01000000:2.0:1789597165.645972:0:24116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789597165.646021:0:24116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.646030:0:24116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.646043:0:24116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597165.646072:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789597165.646156:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.646209:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.646441:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923264 00000100:00100000:3.0:1789597165.646450:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923264 00000100:00100000:3.0:1789597165.646517:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789597165.646527:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:24116:x1876527984923264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597165.646553:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597165.646708:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0519 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.646743:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 20 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.646756:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 20 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.646764:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80030a00, rc 0) 00000100:00100000:3.0:1789597165.646810:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923264:12345-0@lo:101:mount.lustre.0 Request processed in 285us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.646816:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789597165.647136:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597165.647153:0:24116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.647165:0:24116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789597165.649148:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1789597165.650311:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789597165.652139:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789597165.652178:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1789597165.652189:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1789597165.652200:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1789597165.652211:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1789597165.652230:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1789597165.652241:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1789597165.652254:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1789597165.652267:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1789597165.652282:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1789597165.652293:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1789597165.652311:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1789597165.652316:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1789597165.653197:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597165.653264:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.653301:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88f59780 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.653711:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923392 00000100:00100000:3.0:1789597165.653727:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923392 00000100:00100000:3.0:1789597165.653858:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789597165.653870:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597165.654721:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923392:12345-0@lo:501:mount.lustre.0 Request processed in 850us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.654731:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789597165.656102:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597165.656167:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789597165.656238:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.656287:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88f59780 going to sleep for 11 seconds 00000100:00100000:0.0:1789597165.656709:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923520 00000100:00100000:0.0:1789597165.656717:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923520 00000100:00100000:0.0:1789597165.656842:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789597165.656854:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597165.657118:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923520:12345-0@lo:503:mount.lustre.0 Request processed in 266us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597165.657127:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789597165.657868:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789597165.659451:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789597165.663282:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597165.663385:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.663440:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9187c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.663705:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923648 00000100:00100000:3.0:1789597165.663713:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923648 00000100:00100000:3.0:1789597165.663838:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789597165.663848:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597165.665165:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923648:12345-0@lo:502:mount.lustre.0 Request processed in 890us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.665178:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789597165.665735:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789597165.666308:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789597165.666339:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789597165.666354:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789597165.666367:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789597165.666380:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789597165.666393:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789597165.666416:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789597165.666430:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789597165.666442:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789597165.666455:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1789597165.666468:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1789597165.666519:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597165.668980:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.669041:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.669708:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923776 00000100:00100000:3.0:1789597165.669719:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923776 00000100:00100000:3.0:1789597165.669793:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789597165.669804:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597165.669973:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923776:12345-0@lo:502:mount.lustre.0 Request processed in 170us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.669981:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789597165.670885:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789597165.671724:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789597165.671875:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789597165.675165:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597165.675180:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675183:0:24137:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789597165.675191:0:24137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7e9dfc1800 00000020:00000080:3.0:1789597165.675194:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597165.675202:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597165.675204:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675206:0:24137:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789597165.675215:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597165.675217:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675219:0:24137:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789597165.675222:0:24137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7e9dfc1800 00000020:00000080:3.0:1789597165.675225:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597165.675278:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597165.675281:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675283:0:24137:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789597165.675285:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597165.675287:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675289:0:24137:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789597165.675292:0:24137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7e9dfc1800 00000020:00000080:3.0:1789597165.675294:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597165.675311:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597165.675314:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675316:0:24137:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789597165.675318:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789597165.675320:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675322:0:24137:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789597165.675325:0:24137:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7e9dfc1800 00000020:00000080:3.0:1789597165.675328:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789597165.675348:0:24137:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789597165.675350:0:24137:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789597165.675352:0:24137:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789597165.675355:0:24137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789597165.675428:0:24116:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789597165.675455:0:24116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789597165.675475:0:24116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.675502:0:24116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597165.679077:0:24116:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789597165.679089:0:24116:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7e9dfc1800 10000000:01000000:3.0:1789597165.679093:0:24116:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7e9dfc1800 10000000:01000000:3.0:1789597165.679098:0:24116:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789597165.679109:0:24116:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7e9dfc1800 from 1 10000000:01000000:3.0:1789597165.679112:0:24116:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789597165.679154:0:24116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bc0527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.679166:0:24116:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bc0527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.679178:0:24116:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bc0527 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597165.679205:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597165.679282:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597165.679337:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789597165.679706:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984923904 00000100:00100000:2.0:1789597165.679715:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984923904 00000100:00100000:2.0:1789597165.679778:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789597165.679788:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+20:24116:x1876527984923904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597165.679802:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597165.679815:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dc400/0x7b5398e289bc052e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0527 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.679842:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dc400/0x7b5398e289bc052e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0527 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.679853:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dc400/0x7b5398e289bc052e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0527 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.679862:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc400, rc 0) 00000100:00100000:2.0:1789597165.679906:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984923904:12345-0@lo:101:mount.lustre.0 Request processed in 120us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597165.679914:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789597165.680850:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984923904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789597165.680871:0:24116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bc0527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc052e expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.680881:0:24116:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bc0527 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc052e expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789597165.695915:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789597165.698088:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789597165.698332:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789597165.698355:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789597165.698366:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789597165.698378:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789597165.698396:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789597165.698406:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789597165.698416:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789597165.698426:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789597165.698437:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789597165.698447:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789597165.698458:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789597165.698468:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789597165.698479:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789597165.698534:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789597165.698549:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789597165.698562:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789597165.699321:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789597165.699344:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789597165.699358:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789597165.699369:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789597165.699381:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789597165.699392:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789597165.699402:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789597165.699414:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789597165.699452:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789597165.699467:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789597165.699479:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789597165.699504:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789597165.699517:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789597165.699529:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789597165.699542:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789597165.699555:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789597165.699577:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789597165.699591:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789597165.699604:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789597165.699617:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789597165.699631:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789597165.699655:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789597165.699669:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789597165.699702:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789597165.699732:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789597165.699761:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789597165.699776:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789597165.699790:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789597165.699804:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789597165.699818:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789597165.699833:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789597165.699847:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789597165.700001:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789597165.700032:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789597165.700049:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789597165.700056:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789597165.700182:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597165.700270:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.700329:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.702752:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924032 00000100:00100000:3.0:1789597165.702773:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924032 00000100:00100000:3.0:1789597165.702869:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789597165.702888:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597165.703108:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924032:12345-0@lo:501:mount.lustre.0 Request processed in 223us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.703116:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789597165.703722:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597165.703907:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597165.704203:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.704254:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.704330:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924160 00000100:00100000:3.0:1789597165.704337:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924160 00000100:00100000:3.0:1789597165.704386:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789597165.704396:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789597165.704524:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924160:12345-0@lo:503:mount.lustre.0 Request processed in 129us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.704531:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789597165.704722:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924160:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789597165.707674:0:24116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789597165.708733:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597165.708884:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.709145:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.709672:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924288 00000100:00100000:3.0:1789597165.710101:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924288 00000100:00100000:3.0:1789597165.710168:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789597165.710180:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597165.710366:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924288:12345-0@lo:502:mount.lustre.0 Request processed in 189us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.710377:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789597165.710889:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597165.712379:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789597165.712429:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789597165.712443:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789597165.712476:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789597165.712509:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789597165.712523:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789597165.712537:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789597165.712549:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789597165.712562:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789597165.712588:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789597165.712602:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789597165.712614:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789597165.712627:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789597165.712640:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789597165.712653:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789597165.712666:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789597165.712711:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789597165.712728:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789597165.714926:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789597165.715326:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789597165.715348:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789597165.715362:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789597165.715375:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789597165.715389:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789597165.715402:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789597165.715415:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789597165.715428:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789597165.715441:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789597165.715454:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789597165.715467:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789597165.715480:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789597165.715509:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789597165.715535:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789597165.715548:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789597165.715563:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789597165.715602:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789597165.715617:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789597165.715630:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789597165.715643:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789597165.715655:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789597165.715668:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789597165.715714:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789597165.715732:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789597165.715969:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789597165.715987:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789597165.715999:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789597165.716023:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789597165.716038:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789597165.716099:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924416:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597165.716177:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.716228:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924416 00000100:00100000:1.0:1789597165.716237:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924416 00000100:00100000:1.0:1789597165.716285:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789597165.716294:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597165.716414:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924416:12345-0@lo:502:mount.lustre.0 Request processed in 119us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.716422:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789597165.716478:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d825b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1789597165.716514:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924416:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597165.716746:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789597165.716772:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789597165.716800:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597165.716836:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.716853:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867a5300 going to sleep for 11 seconds 00000100:00100000:3.0:1789597165.723180:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924544 00000100:00100000:3.0:1789597165.723194:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924544 00000100:00100000:3.0:1789597165.723256:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789597165.723266:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597165.724020:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984924544:12345-0@lo:502:mount.lustre.0 Request processed in 750us (7178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597165.724029:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789597165.728060:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984924544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789597165.733088:0:24116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789597165.733112:0:24116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789597165.744833:0:24142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789597165.744853:0:24142:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c7ebb1899c0) 00000020:00000080:1.0:1789597165.744882:0:24142:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789597165.744999:0:24142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7e9dfc1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789597165.745004:0:24142:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7e9dfc1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789597165.745007:0:24142:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e9dfc1800 3 00010000:00080000:1.0:1789597165.745317:0:24142:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e9ddee800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789597165.750151:0:24142:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789597165.750378:0:24142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789597165.750428:0:24142:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789597165.750442:0:24142:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7b5398e289bc053c 00000100:00080000:1.0:1789597165.750455:0:24142:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789597165.750470:0:24142:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c7e9ddee800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597165.750529:0:24142:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb025c00 x1876527984924672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597165.750563:0:24142:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789597165.751088:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984924672:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789597165.751165:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789597165.751369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.751375:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597165.751377:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.751381:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597165.751409:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.751412:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597165.751414:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.751427:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789597165.751454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984925184:0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.751481:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.751515:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597165.751520:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984924800:0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.751553:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.751765:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984925056:0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.751791:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.751815:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597165.751820:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984924928:0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.751837:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.751863:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924800 00000100:00100000:1.0:1789597165.751871:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924800 00000100:00100000:1.0:1789597165.751912:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925056 00000100:00100000:1.0:1789597165.751915:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925056 00000100:00100000:1.0:1789597165.751930:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789597165.751938:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984924800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.751993:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984924800:12345-0@lo:400:kworker.0 Request processed in 56us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.752000:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789597165.752028:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789597165.752034:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984925056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.752060:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984925056:12345-0@lo:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.752065:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789597165.752080:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924672 00000100:00100000:1.0:1789597165.752090:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924672 00000100:00100000:1.0:1789597165.752103:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925184 00000100:00100000:1.0:1789597165.752104:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925184 00000100:00100000:1.0:1789597165.752117:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984924928 00000100:00100000:1.0:1789597165.752118:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984924928 00000100:00100000:1.0:1789597165.752129:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789597165.752134:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984925184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.752159:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984925184:12345-0@lo:400:kworker.0 Request processed in 25us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.752165:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789597165.752173:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597165.752178:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984924928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.752197:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984924928:12345-0@lo:400:kworker.0 Request processed in 19us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.752202:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597165.752210:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789597165.752214:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984924672:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789597165.752233:0:22613:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:1.0:1789597165.752266:0:22613:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7b5398e289bc0543 00000004:00100000:1.0:1789597165.752280:0:22613:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789597165.752307:0:22613:0:(import.c:65:import_set_state_nolock()) ffff9c7eb98c4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597165.752353:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876527984924672:12345-0@lo:38:llog_process_th.0 Request processed in 138us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.752360:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789597165.752390:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb024700 x1876527984924928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597165.752403:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984924928:0@lo:400:kworker.0 00000100:00100000:1.0:1789597165.752418:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984925056:0@lo:400:kworker.0 00010000:00080000:1.0:1789597165.752447:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb025c00 x1876527984924672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597165.752455:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789597165.752461:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789597165.752468:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789597165.752472:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789597165.752475:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9ddee800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789597165.752480:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876527984924672:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789597165.752514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984924800:0@lo:400:kworker.0 00010000:00080000:1.0:1789597165.752523:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c7ebb026680 x1876527984925184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597165.752531:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984925184:0@lo:400:kworker.0 00010000:00010000:1.0:1789597165.757973:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789597165.759060:0:24142:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789597165.759086:0:24142:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c7ebb18cd40) 00000020:00000080:1.0:1789597165.759122:0:24142:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1789597165.759215:0:24142:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7e9dfc1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789597165.759219:0:24142:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7e9dfc1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789597165.759222:0:24142:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7e9dfc1800 3 00010000:00080000:1.0:1789597165.759279:0:24142:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7e9dde8000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.116@tcp at head 00010000:00010000:1.0:1789597165.763360:0:24142:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1789597165.764858:0:24142:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789597165.764925:0:24142:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789597165.764957:0:24142:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x7b5398e289bc0551 00000100:00080000:1.0:1789597165.764975:0:24142:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789597165.764991:0:24142:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c7e9dde8000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597165.768823:0:24142:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ec1fe7480 x1876527984925312/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789597165.768876:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984925312:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789597165.768973:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.769312:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925312 00000100:00100000:1.0:1789597165.769321:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925312 00000100:00100000:1.0:1789597165.769369:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789597165.769377:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876527984925312:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789597165.769407:0:22613:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 740 last 0 00000020:00000080:1.0:1789597165.769445:0:22613:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x7b5398e289bc0558 00000004:00100000:1.0:1789597165.769463:0:22613:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789597165.769509:0:22613:0:(import.c:65:import_set_state_nolock()) ffff9c7d8357c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597165.769643:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876527984925312:12345-0@lo:38:llog_process_th.0 Request processed in 264us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.769650:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789597165.769719:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ec1fe7480 x1876527984925312/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597165.769730:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789597165.769803:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789597165.769813:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789597165.769818:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789597165.769821:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9dde8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789597165.769828:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876527984925312:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789597165.769860:0:24142:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789597165.769885:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.769890:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597165.769893:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.769896:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597165.769900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.769903:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789597165.769906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597165.769909:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789597165.771182:0:24142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789597165.771876:0:24116:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789597165.771923:0:24116:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789597165.771953:0:24116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bc0527 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc052e expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597165.771968:0:24116:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031c00/0x7b5398e289bc0527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc052e expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789597165.772872:0:24116:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789597165.772878:0:24116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789597165.772879:0:24116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597165.772881:0:24116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597165.772882:0:24116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597165.772886:0:24116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597165.772888:0:24116:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789597165.772890:0:24116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597165.772891:0:24116:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789597165.772897:0:24116:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789597165.772900:0:24116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789597165.772902:0:24116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789597165.772903:0:24116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789597165.772905:0:24116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789597165.772906:0:24116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789597165.772907:0:24116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789597165.772908:0:24116:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789597165.772910:0:24116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789597165.772911:0:24116:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789597165.772946:0:24116:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789597165.772971:0:24116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb0c21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984925440:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789597165.773362:0:24116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597165.773427:0:24116:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e834cb480 going to sleep for 11 seconds 00000100:00100000:1.0:1789597165.773512:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925440 00000100:00100000:1.0:1789597165.773521:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925440 00000100:00100000:1.0:1789597165.774601:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789597165.774617:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984925440:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789597165.774649:0:22606:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789597165.774663:0:22606:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789597165.781880:0:22606:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789597165.781907:0:22606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789597165.782143:0:22629:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789597165.782150:0:22629:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789597165.782176:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.782197:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.782205:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 21 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.782213:0:22629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.782254:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 21 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.782270:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 21 pid: 22607 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597165.782285:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984925568:0@lo:104: 00000100:00100000:0.0:1789597165.782364:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789597165.782413:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.782423:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 21 pid: 22606 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597165.782432:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984925696:0@lo:104: 00000100:00100000:0.0:1789597165.782459:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597165.782475:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88b33b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789597165.782521:0:22597:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789597165.782539:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925568 00000100:00100000:2.0:1789597165.782800:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:24116:x1876527984925440:12345-0@lo:253:mount.lustre.0 Request processed in 8187us (9438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597165.782812:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789597165.783097:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925568 00000100:00100000:0.0:1789597165.783133:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925696 00000100:00100000:0.0:1789597165.783136:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925696 00000100:00100000:0.0:1789597165.783148:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789597165.783156:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:22629:x1876527984925568:12345-0@lo:104: 00010000:00010000:0.0:1789597165.783170:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.783227:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789597165.783233:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:22629:x1876527984925568:12345-0@lo:104: Request processed in 78us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597165.783240:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789597165.783254:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789597165.783260:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ead418050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984925696:12345-0@lo:104: 00010000:00010000:0.0:1789597165.783268:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597165.783337:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789597165.783343:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ead418050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984925696:12345-0@lo:104: Request processed in 84us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597165.783349:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789597165.783413:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984925568:0@lo:104: 00000100:00100000:0.0:1789597165.783422:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984925696:0@lo:104: 00010000:00010000:0.0:1789597165.783441:0:22629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783601:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597165.783609:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783618:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597165.783622:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783630:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597165.783642:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597165.783646:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789597165.783699:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783706:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597165.783726:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783734:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d83742200/0x7b5398e289bc04b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04b7 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783757:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597165.783760:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783766:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597165.783769:0:22601:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783776:0:22601:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597165.783782:0:22601:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597165.783787:0:22601:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789597165.783808:0:22601:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783814:0:22601:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597165.783830:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783837:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d83742c00/0x7b5398e289bc04a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04a9 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.783853:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597165.783855:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597165.783857:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597165.783880:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984925824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597165.783921:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.783963:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980ee822-f655-4df0-a283-f316bd6c264b:3646:1876527984925952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597165.783987:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597165.784021:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925824 00000100:00100000:1.0:1789597165.784026:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925824 00010000:00010000:1.0:1789597165.784047:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 21 pid: 22607 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597165.784068:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984925952 00000100:00100000:1.0:1789597165.784071:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984925952 00010000:00010000:1.0:1789597165.784081:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 22 pid: 22606 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597165.784093:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789597165.784100:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+22:3645:x1876527984925824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789597165.784113:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597165.784125:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 22 pid: 22607 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784138:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 22 pid: 22607 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784154:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83743600/0x7b5398e289bc04b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc04b0 expref: 22 pid: 22607 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784167:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597165.784195:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+21:3645:x1876527984925824:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.784202:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789597165.784215:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789597165.784221:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83179050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+20:3646:x1876527984925952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789597165.784228:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597165.784233:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 20 pid: 22606 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784242:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 20 pid: 22606 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784252:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d83742400/0x7b5398e289bc04a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc04a2 expref: 20 pid: 22606 timeout: 840 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784263:0:22600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784272:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789597165.784297:0:22600:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013493171s 00010000:00010000:1.0:1789597165.784304:0:22600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784314:0:22600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784323:0:22600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784331:0:22600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784337:0:22600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597165.784342:0:22600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784350:0:22600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784366:0:22600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784376:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597165.784401:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83179050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+19:3646:x1876527984925952:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597165.784409:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789597165.784462:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984925824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597165.784482:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980ee822-f655-4df0-a283-f316bd6c264b:3646:1876527984925952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789597165.784520:0:22629:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784530:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597165.784537:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc055f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597165.785353:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597165.785775:0:24116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb0c21880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24116:1876527984925440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789597165.785793:0:24116:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789597165.785797:0:24116:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789597165.785799:0:24116:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789597165.785800:0:24116:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597165.785802:0:24116:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597165.785804:0:24116:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597165.785805:0:24116:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597165.785807:0:24116:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597165.785809:0:24116:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597165.785810:0:24116:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789597165.785823:0:24116:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1789597165.791079:0:24116:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1789597165.797344:0:24116:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789597165.797355:0:24116:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789597165.797393:0:24116:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789597165.797437:0:24116:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789597165.797455:0:24116:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789597165.797475:0:24116:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789597165.798768:0:24116:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789597165.799002:0:24116:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789597166.787816:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789597167.219175:0:24196:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789597167.219375:0:24196:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789597167.485326:0:22610:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789597167.485337:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb98c4000 from 13 10000000:01000000:1.0:1789597167.485343:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789597167.485400:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597167.485413:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597167.485426:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597167.485458:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789597167.485550:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597167.485612:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83710300 going to sleep for 11 seconds 00000100:00100000:3.0:1789597167.486506:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926080 00000100:00100000:3.0:1789597167.486518:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926080 00000100:00100000:3.0:1789597167.486573:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789597167.486585:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+19:22610:x1876527984926080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597167.486600:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597167.486621:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0566 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.486648:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 20 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.486659:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 20 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.486668:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e80031200, rc 0) 00000100:00100000:3.0:1789597167.486749:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:22610:x1876527984926080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597167.486756:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789597167.489334:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597167.489379:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.489393:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597167.489465:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789597167.489548:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597167.489599:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0ef0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789597167.496091:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926208 00000100:00100000:2.0:1789597167.496110:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926208 00000100:00100000:3.0:1789597167.496417:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789597167.496432:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:22610:x1876527984926208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789597167.496465:0:22607:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789597167.496499:0:22607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789597167.496503:0:22607:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789597167.496656:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:22610:x1876527984926208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 229us (7107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597167.496664:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789597167.496735:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789597167.496822:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789597167.496833:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.496846:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597167.496858:0:22610:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789597167.496861:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d83162800 from 13 10000000:01000000:3.0:1789597167.496870:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789597167.496907:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.496915:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.496925:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597167.496947:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789597167.496981:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597167.497012:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0ef0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789597167.497027:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926336 00000100:00100000:3.0:1789597167.497032:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926336 00000100:00100000:3.0:1789597167.497058:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789597167.497065:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+20:22610:x1876527984926336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597167.497074:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597167.497090:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0574 expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.497110:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 21 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.497121:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 21 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.497128:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:3.0:1789597167.497155:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984926336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597167.500894:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789597167.500991:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597167.501018:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.501031:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597167.501124:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789597167.501915:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597167.501971:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb0ef0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789597167.501998:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926464 00000100:00100000:3.0:1789597167.502005:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926464 00000100:00100000:3.0:1789597167.502047:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789597167.502056:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984926464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789597167.502158:0:22606:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789597167.502322:0:22606:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789597167.502326:0:22606:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1789597167.502423:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984926464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 367us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597167.502431:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789597167.502491:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984926464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789597167.502547:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789597167.502557:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.502578:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597167.820895:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597168.068824:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984926592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597168.068912:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597168.068980:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926592 00000100:00100000:1.0:1789597168.068989:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926592 00000100:00100000:1.0:1789597168.069044:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789597168.069053:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984926592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597168.069085:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789597168.069130:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984926592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597168.069136:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789597168.069183:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984926592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597168.579149:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789597168.579174:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984926720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597168.579244:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597168.583349:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926720 00000100:00100000:2.0:1789597168.583370:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926720 00000100:00100000:2.0:1789597168.583442:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789597168.583453:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984926720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789597168.583505:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597168.583607:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984926720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (4362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597168.583615:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789597168.583705:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984926720:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789597168.828882:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789597169.213464:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789597169.855079:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597170.878094:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789597171.140781:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597171.140789:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597171.140792:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597171.140795:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597171.140812:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597171.140816:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597171.140818:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597171.140821:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789597171.141386:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984926848:0@lo:400:kworker.0 00000100:00100000:2.0:1789597171.141470:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597171.141519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984927360:0@lo:400:kworker.0 00000100:00100000:2.0:1789597171.141545:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597171.141570:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789597171.141575:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984927232:0@lo:400:kworker.0 00000100:00100000:2.0:1789597171.141607:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597171.141646:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984927360 00000100:00100000:2.0:1789597171.141655:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984927360 00000100:00100000:0.0:1789597171.141755:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926848 00000100:00100000:0.0:1789597171.141760:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926848 00000100:00100000:0.0:1789597171.141804:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789597171.141814:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:3645:x1876527984926848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597171.141876:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:3645:x1876527984926848:12345-0@lo:400:kworker.0 Request processed in 64us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597171.141884:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789597171.142369:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984926976:0@lo:400:kworker.0 00000100:00100000:1.0:1789597171.142401:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597171.142429:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984927488:0@lo:400:kworker.0 00000100:00100000:1.0:1789597171.142461:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597171.142481:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789597171.142487:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984927104:0@lo:400:kworker.0 00000100:00100000:1.0:1789597171.142508:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597171.142525:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984927616:0@lo:400:kworker.0 00000100:00100000:1.0:1789597171.142549:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597171.142570:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984927488 00000100:00100000:1.0:1789597171.142581:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984927488 00000100:00100000:1.0:1789597171.142615:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984927104 00000100:00100000:1.0:1789597171.142618:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984927104 00000100:00100000:1.0:1789597171.142630:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984927616 00000100:00100000:1.0:1789597171.142632:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984927616 00000100:00100000:1.0:1789597171.142645:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789597171.142652:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984927488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597171.142729:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876527984927488:12345-0@lo:400:kworker.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597171.142735:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789597171.142749:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597171.142755:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984927104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597171.142781:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984927104:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597171.142786:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597171.142797:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789597171.142803:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984927616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597171.142828:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984927616:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597171.142833:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789597171.142867:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f0aa00 x1876527984927104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597171.142881:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984927104:0@lo:400:kworker.0 00010000:00080000:1.0:1789597171.142892:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f0a300 x1876527984927616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597171.142900:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984927616:0@lo:400:kworker.0 00010000:00080000:1.0:1789597171.142919:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f0b800 x1876527984927488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597171.142927:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876527984927488:0@lo:400:kworker.0 00000100:00100000:2.0:1789597171.143075:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597171.143082:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984927360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597171.143114:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876527984927360:12345-0@lo:400:kworker.0 Request processed in 33us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597171.143121:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597171.143142:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984927232 00000100:00100000:2.0:1789597171.143147:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984927232 00000100:00100000:2.0:1789597171.143167:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984926976 00000100:00100000:2.0:1789597171.143170:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984926976 00000100:00100000:2.0:1789597171.143185:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789597171.143191:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984927232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597171.143223:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984927232:12345-0@lo:400:kworker.0 Request processed in 32us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597171.143228:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789597171.143239:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789597171.143244:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984926976:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789597171.144995:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789597171.145004:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789597171.146452:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984927232:0@lo:400:kworker.0 00000100:00100000:0.0:1789597171.146471:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984926848:0@lo:400:kworker.0 00010000:00080000:0.0:1789597171.146486:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f0b480 x1876527984927360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597171.146497:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876527984927360:0@lo:400:kworker.0 00000100:00100000:2.0:1789597171.148167:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984926976:12345-0@lo:400:kworker.0 Request processed in 4912us (5755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597171.148182:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789597171.153378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984926976:0@lo:400:kworker.0 00010000:00010000:1.0:1789597171.901925:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597172.925309:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597157/real 1789597157] req@ffff9c7e85f08700 x1876527984919552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597172 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597172.925343:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7e85f08700 x1876527984919552/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597172 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597172.925366:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597157/real 1789597157] req@ffff9c7e85f09f80 x1876527984919680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597172 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597172.925379:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7e85f09f80 x1876527984919680/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597172 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789597172.925399:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5587000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597172.925433:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789597172.925437:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984919552:0@lo:8:kworker.0 00000100:00080000:1.0:1789597172.925444:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789597172.925449:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789597172.925453:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984919680:0@lo:8:kworker.0 00000100:00080000:0.0:1789597172.926057:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597172.926063:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597172.926066:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597172.926069:0:14919:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789597172.926090:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597172.926093:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789597172.926097:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5587000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597172.926103:0:14919:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 732 00000100:00080000:0.0:1789597172.926108:0:14919:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789597172.926120:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c7eb5587000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597172.926143:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f09f80 x1876527984928256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789597172.926156:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789597172.926170:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789597172.926172:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789597172.926175:0:14919:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 732 00000100:00080000:0.0:1789597172.926178:0:14919:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789597172.926183:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7eb66a8800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:0.0:1789597172.926197:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e85f08700 x1876527984928384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789597172.926377:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984927744:0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.926455:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597172.926504:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984928512:0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.926530:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597172.926561:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789597172.926567:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984927872:0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.926592:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597172.926612:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984928640:0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.926632:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789597172.926657:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597172.926670:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984927872 00000100:00100000:2.0:1789597172.926707:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984927872 00000100:00100000:2.0:1789597172.926753:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789597172.926761:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984927872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.926816:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984927872:12345-0@lo:400:kworker.0 Request processed in 55us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597172.926823:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789597172.926846:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928512 00000100:00100000:2.0:1789597172.926850:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928512 00000100:00100000:2.0:1789597172.926875:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928640 00000100:00100000:2.0:1789597172.926878:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928640 00000100:00100000:2.0:1789597172.926893:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789597172.926898:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb0c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984928512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.926925:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb0c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984928512:12345-0@lo:400:kworker.0 Request processed in 27us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597172.926931:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789597172.926941:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789597172.926946:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984928640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.926967:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984928640:12345-0@lo:400:kworker.0 Request processed in 22us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597172.926972:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789597172.927032:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984927872:0@lo:400:kworker.0 00010000:00080000:2.0:1789597172.927043:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f0b800 x1876527984928640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597172.927052:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984928640:0@lo:400:kworker.0 00010000:00080000:2.0:1789597172.927060:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f08380 x1876527984928512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597172.927067:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984928512:0@lo:400:kworker.0 00000100:00100000:1.0:1789597172.927217:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984928000:0@lo:400:kworker.0 00000100:00100000:1.0:1789597172.927248:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597172.927278:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984928768:0@lo:400:kworker.0 00000100:00100000:1.0:1789597172.927310:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597172.927329:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789597172.927335:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984928128:0@lo:400:kworker.0 00000100:00100000:1.0:1789597172.927373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597172.927416:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928000 00000100:00100000:1.0:1789597172.927429:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928000 00000100:00100000:1.0:1789597172.927449:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928768 00000100:00100000:1.0:1789597172.927452:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928768 00000100:00100000:1.0:1789597172.927465:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789597172.927473:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984928000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597172.927510:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876527984928000:12345-0@lo:400:kworker.0 Request processed in 38us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597172.927515:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789597172.927528:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789597172.927534:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984928768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597172.927559:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876527984928768:12345-0@lo:400:kworker.0 Request processed in 26us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597172.927565:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789597172.927591:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f09180 x1876527984928000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597172.927600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876527984928000:0@lo:400:kworker.0 00010000:00080000:1.0:1789597172.927609:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f0a300 x1876527984928768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597172.927615:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876527984928768:0@lo:400:kworker.0 00000100:00100000:1.0:1789597172.927637:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984928256:0@lo:8:kworker.0 00000100:00100000:1.0:1789597172.927671:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597172.927722:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984928384:0@lo:8:kworker.0 00000100:00100000:1.0:1789597172.927746:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597172.927888:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984927744 00000100:00100000:0.0:1789597172.927892:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984927744 00000100:00100000:0.0:1789597172.927928:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789597172.927935:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:3644:x1876527984927744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597172.927976:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:3644:x1876527984927744:12345-0@lo:400:kworker.0 Request processed in 42us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597172.927981:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789597172.928055:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928128 00000100:00100000:2.0:1789597172.928059:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928128 00000100:00100000:2.0:1789597172.928091:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789597172.928097:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984928128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597172.928132:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984928128:12345-0@lo:400:kworker.0 Request processed in 35us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597172.928137:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789597172.928160:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928256 00000100:00100000:2.0:1789597172.928163:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928256 00000100:00100000:2.0:1789597172.928178:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928384 00000100:00100000:2.0:1789597172.928181:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928384 00000100:00100000:2.0:1789597172.928188:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789597172.928192:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984928256:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789597172.928217:0:24121:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 747 last 0 00000020:00000080:2.0:1789597172.928243:0:24121:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bc0582 00002000:00100000:2.0:1789597172.928257:0:24121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c7d83406000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789597172.928262:0:24121:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789597172.928265:0:24121:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789597172.928924:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984927744:0@lo:400:kworker.0 00002000:00080000:2.0:1789597172.929101:0:24121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1789597172.929567:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984928128:0@lo:400:kworker.0 00000100:00080000:2.0:1789597172.931557:0:24121:0:(import.c:65:import_set_state_nolock()) ffff9c7d83407000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597172.931673:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984928256:12345-0@lo:8:kworker.0 Request processed in 3474us (3998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597172.931700:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789597172.931729:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789597172.931736:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984928384:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789597172.931755:0:24121:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597172.931790:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984928384:12345-0@lo:8:kworker.0 Request processed in 53us (4042us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597172.931796:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789597172.931897:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f09f80 x1876527984928256/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597172.931910:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789597172.931919:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789597172.931928:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789597172.931933:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789597172.931935:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb5587000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789597172.931962:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789597172.931968:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984928256:0@lo:8:kworker.0 00000100:00080000:0.0:1789597172.931987:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789597172.931999:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789597172.932003:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984928384:0@lo:8:kworker.0 00000100:00100000:1.0:1789597172.932502:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984928896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597172.932549:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789597172.932605:0:23357:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789597172.932627:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23357:1876527984929024:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789597172.932659:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597172.932700:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e99352540 going to sleep for 11 seconds 00000100:00100000:2.0:1789597172.932721:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929024 00000100:00100000:2.0:1789597172.932727:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929024 00000100:00100000:2.0:1789597172.932769:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789597172.932776:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23357:x1876527984929024:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:2.0:1789597172.932980:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597172.933783:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984928896 00000100:00100000:0.0:1789597172.933791:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984928896 00000100:00100000:0.0:1789597172.933831:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789597172.933841:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876527984928896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597172.933863:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000004:00080000:3.0:1789597172.933972:0:23356:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789597172.934055:0:23356:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 747752376205ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789597172.934061:0:23356:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789597172.939003:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876527984928896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5156us (6445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597172.939019:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:2.0:1789597172.945262:0:24122:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789597172.945271:0:24122:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789597172.945545:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23357:x1876527984929024:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12765us (12879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597172.945632:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1789597172.946358:0:23347:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:0.0:1789597172.946572:0:23357:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e867e1880 x1876527984929024/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789597188 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597172.946591:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23357:1876527984929024:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789597172.946607:0:23357:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789597172.946660:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23357:1876527984929152:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789597172.946748:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597172.946778:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e99352540 going to sleep for 11 seconds 00000100:00100000:2.0:1789597172.946899:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929152 00000100:00100000:2.0:1789597172.946908:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929152 00000100:00100000:2.0:1789597172.946974:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789597172.946984:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23357:x1876527984929152:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789597172.947015:0:24123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1789597172.947123:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23357:x1876527984929152:12345-0@lo:5:osp-pre-0-1.0 Request processed in 141us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597172.947130:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789597172.947159:0:23357:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e85f08700 x1876527984929152/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789597188 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597172.947168:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23357:1876527984929152:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789597172.947177:0:23357:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00010000:00080000:1.0:1789597172.948620:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e867e1f80 x1876527984928896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597172.948648:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984928896:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789597173.186526:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984929280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597173.186606:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597173.187041:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929280 00000100:00100000:0.0:1789597173.187049:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929280 00000100:00100000:0.0:1789597173.187107:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789597173.187117:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984929280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789597173.187159:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789597173.187215:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984929280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597173.187223:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789597173.187468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984929280:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789597173.375027:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789597173.693535:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984929408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597173.693614:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597173.695487:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929408 00000100:00100000:2.0:1789597173.695506:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929408 00000100:00100000:2.0:1789597173.695842:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789597173.695854:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984929408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789597173.695893:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597173.695968:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984929408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (2354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597173.695976:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789597173.698864:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984929408:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789597173.954310:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789597174.028017:0:24487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789597174.984734:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789597175.132067:0:24539:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597175.132622:0:24539:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789597176.003557:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597176.004698:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597156/real 1789597156] req@ffff9c7ebb024a80 x1876527984918400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597176.004727:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7ebb024a80 x1876527984918400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597176.008327:0:3643:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789597156/real 1789597156] req@ffff9c7ebb025500 x1876527984918528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597176 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597176.008408:0:3643:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7ebb025500 x1876527984918528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789597176 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789597176.008434:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e294000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597176.008457:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789597176.008461:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984918400:0@lo:8:kworker.0 00000100:00080000:2.0:1789597176.008467:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597176.008472:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789597176.008475:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984918528:0@lo:8:kworker.0 00000100:00080000:1.0:1789597176.009039:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597176.009044:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789597176.009047:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e294000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597176.009054:0:14919:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 731 00000100:00080000:1.0:1789597176.009061:0:14919:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789597176.009081:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c7e9e294000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597176.009104:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb024a80 x1876527984929792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597176.009116:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597176.009119:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789597176.009121:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597176.009124:0:14919:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 731 00000100:00080000:1.0:1789597176.009126:0:14919:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789597176.009131:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7e867d7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597176.009142:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb025f80 x1876527984929920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789597176.009178:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789597176.009181:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789597176.009182:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789597176.009185:0:14919:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 747 00000100:00080000:1.0:1789597176.009188:0:14919:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789597176.009192:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7eb66a8800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:1.0:1789597176.009202:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb025c00 x1876527984930432/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789597176.009247:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984929664:0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.009318:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597176.009362:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984930560:0@lo:400:kworker.0 00000100:00100000:2.0:1789597176.009526:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980ee822-f655-4df0-a283-f316bd6c264b:3646:1876527984929536:0@lo:400:kworker.0 00000100:00100000:2.0:1789597176.009560:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.009584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984930304:0@lo:400:kworker.0 00000100:00100000:2.0:1789597176.009605:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.009637:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929536 00000100:00100000:2.0:1789597176.009645:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929536 00000100:00100000:2.0:1789597176.009716:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789597176.009726:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:3646:x1876527984929536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597176.009772:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:3646:x1876527984929536:12345-0@lo:400:kworker.0 Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597176.009779:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789597176.009808:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930304 00000100:00100000:2.0:1789597176.009811:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930304 00000100:00100000:2.0:1789597176.009841:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789597176.009847:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876527984930304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597176.009890:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1876527984930304:12345-0@lo:400:kworker.0 Request processed in 44us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597176.009896:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789597176.009944:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:980ee822-f655-4df0-a283-f316bd6c264b:3646:1876527984929536:0@lo:400:kworker.0 00010000:00080000:2.0:1789597176.009956:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027b80 x1876527984930304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789597192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597176.009966:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984930304:0@lo:400:kworker.0 00000100:00080000:2.0:1789597176.010002:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597176.010020:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984929792:0@lo:8:kworker.0 00000100:00100000:2.0:1789597176.010044:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.010067:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929792 00000100:00100000:2.0:1789597176.010071:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929792 00000100:00100000:2.0:1789597176.010088:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597176.010093:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984929792:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789597176.010120:0:24121:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:2.0:1789597176.010149:0:24121:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bc0589 00002000:00100000:2.0:1789597176.010162:0:24121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c7d83402000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789597176.010167:0:24121:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789597176.010169:0:24121:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789597176.010235:0:24121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789597176.010256:0:24121:0:(import.c:65:import_set_state_nolock()) ffff9c7d83400800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597176.010287:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984929792:12345-0@lo:8:kworker.0 Request processed in 193us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597176.010293:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789597176.010320:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb024a80 x1876527984929792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597176.010335:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789597176.010342:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789597176.010352:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789597176.010357:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789597176.010359:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e9e294000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789597176.010622:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789597176.010629:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984929792:0@lo:8:kworker.0 00000004:00080000:2.0:1789597176.010668:0:22638:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789597176.010706:0:22638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22638:1876527984931072:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789597176.010733:0:22638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.010752:0:22638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597176.010767:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931072 00000100:00100000:2.0:1789597176.010771:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931072 00000100:00100000:2.0:1789597176.010803:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789597176.010810:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22638:x1876527984931072:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1789597176.011144:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597176.011155:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984930944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789597176.011183:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.011219:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930944 00000100:00100000:2.0:1789597176.011223:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930944 00000100:00100000:2.0:1789597176.011247:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789597176.011254:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876527984930944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789597176.011282:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597176.011320:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876527984930944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597176.011334:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789597176.011368:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e867e3b80 x1876527984930944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597176.011505:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597176.011540:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984930048:0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.011573:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597176.011591:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984930688:0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.011610:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597176.011627:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789597176.011633:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984930176:0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.011654:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597176.011671:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984930816:0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.011707:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597176.011732:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929664 00000100:00100000:1.0:1789597176.011736:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929664 00000100:00100000:1.0:1789597176.011762:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930176 00000100:00100000:1.0:1789597176.011765:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930176 00000100:00100000:1.0:1789597176.011777:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789597176.011783:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.011823:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984929664:12345-0@lo:400:kworker.0 Request processed in 39us (2505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597176.011829:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789597176.011842:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789597176.011847:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984930176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.011875:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984930176:12345-0@lo:400:kworker.0 Request processed in 28us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597176.011880:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789597176.011893:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930560 00000100:00100000:1.0:1789597176.011896:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930560 00000100:00100000:1.0:1789597176.011982:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930048 00000100:00100000:1.0:1789597176.011986:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930048 00000100:00100000:1.0:1789597176.012000:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930688 00000100:00100000:1.0:1789597176.012008:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930688 00000100:00100000:1.0:1789597176.012032:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930816 00000100:00100000:1.0:1789597176.012034:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930816 00000100:00100000:1.0:1789597176.012048:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789597176.012054:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.012082:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984930560:12345-0@lo:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597176.012088:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789597176.012101:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597176.012107:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984930048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.012145:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984930048:12345-0@lo:400:kworker.0 Request processed in 38us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597176.012152:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597176.012163:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789597176.012169:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.012194:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984930688:12345-0@lo:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597176.012199:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789597176.012210:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789597176.012215:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984930816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597176.012240:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984930816:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597176.012245:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789597176.012273:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789597176.012277:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789597176.012295:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984930176:0@lo:400:kworker.0 00010000:00080000:1.0:1789597176.012318:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d8442d500 x1876527984930816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597176.012327:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984930816:0@lo:400:kworker.0 00010000:00080000:1.0:1789597176.012337:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb025180 x1876527984930048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597176.012345:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984930048:0@lo:400:kworker.0 00010000:00080000:1.0:1789597176.012353:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb024700 x1876527984930688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597176.012362:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984930688:0@lo:400:kworker.0 00000100:00100000:2.0:1789597176.012780:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984930944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597176.013063:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984929664:0@lo:400:kworker.0 00010000:00080000:1.0:1789597176.013076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027800 x1876527984930560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597176.013085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984930560:0@lo:400:kworker.0 00000100:00100000:2.0:1789597176.013539:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984929920:0@lo:8:kworker.0 00000100:00100000:2.0:1789597176.013587:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.013622:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984930432:0@lo:8:kworker.0 00000100:00100000:2.0:1789597176.013648:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.013672:0:24121:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789597176.013720:0:24121:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:0.0:1789597176.013931:0:22637:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789597176.014018:0:22637:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 750832338305ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789597176.014025:0:22637:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789597176.014708:0:24122:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789597176.014718:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984929920 00000100:00100000:1.0:1789597176.014726:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984929920 00000100:00100000:1.0:1789597176.014750:0:24122:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789597176.014754:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984930432 00000100:00100000:1.0:1789597176.014756:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984930432 00000004:00080000:0.0:1789597176.017044:0:22593:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789597176.017072:0:24123:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789597176.017080:0:24123:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1789597176.017087:0:24123:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000100:00100000:2.0:1789597176.018222:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597176.018234:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1876527984929920:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789597176.018258:0:24573:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597176.018343:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1876527984929920:12345-0@lo:8:kworker.0 Request processed in 109us (4754us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597176.018350:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789597176.019507:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597176.019518:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597176.019523:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984929920:0@lo:8:kworker.0 00000100:00100000:2.0:1789597176.019566:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597176.019572:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1876527984930432:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789597176.019590:0:24573:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789597176.019647:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1876527984930432:12345-0@lo:8:kworker.0 Request processed in 74us (5998us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789597176.019663:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789597176.019706:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789597176.019710:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789597176.019714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984930432:0@lo:8:kworker.0 00002000:00010000:0.0:1789597176.033329:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597176.033348:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033368:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1789597176.033386:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597176.033399:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033421:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033433:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033440:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033460:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597176.033660:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597176.033668:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033698:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.033704:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033714:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033732:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033741:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089a5dbf0/0x7b5398e289bc0590 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.033759:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.033761:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.033763:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597176.035060:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.035073:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.035087:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.035099:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.035105:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.035118:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.035127:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.035133:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.035149:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789597176.036750:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.036761:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.036776:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.036780:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.036784:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.036797:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.036805:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.036819:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.036837:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789597176.037487:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.037494:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.037503:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.037506:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.037511:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.037522:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.037530:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.037537:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.037546:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789597176.038883:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.038895:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.039283:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789597176.039292:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.039300:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.039305:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.039326:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.039347:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.039353:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000467e0dbc/0x7b5398e289bc0597 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.039450:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.039455:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.039461:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.039472:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.039482:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.039491:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.039504:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789597176.040577:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789597176.040585:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.040596:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.040600:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.040609:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.040623:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.040630:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000341e9aa3/0x7b5398e289bc059e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789597176.045041:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.045059:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.045081:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.045087:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.045094:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.045112:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.045140:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.045148:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.045160:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789597176.058187:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.058203:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.058223:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.058228:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.058235:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.058251:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.058261:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.058269:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.058298:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789597176.061219:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00002000:00010000:1.0:1789597176.061328:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.061338:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.061355:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.061359:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.061366:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.061400:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.061412:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.061419:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.061429:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789597176.062165:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.062173:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062183:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.062191:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.062196:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062207:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062216:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062223:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062232:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1789597176.062586:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.062591:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062600:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.062603:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.062606:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062615:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062623:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062636:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.062643:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1789597176.064362:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789597176.064385:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064424:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.064429:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064440:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064458:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064465:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d01bee4/0x7b5398e289bc05a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064486:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789597176.064490:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064507:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.064510:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064518:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064528:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064535:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc05b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064549:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789597176.064553:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064559:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.064561:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064568:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064578:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064589:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003905ac4e/0x7b5398e289bc05ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064601:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789597176.064605:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064610:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.064613:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064619:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064629:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064636:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc05c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064646:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597176.064649:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064656:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.064662:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064670:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064696:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064704:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc05c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064718:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597176.064721:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064726:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.064729:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064735:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064744:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064752:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc05cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.064770:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.064771:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.064774:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597176.065049:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.065057:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065068:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.065072:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.065077:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065089:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065098:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065106:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065126:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597176.065134:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597176.065138:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065144:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dba00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597176.065147:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065156:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065166:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065174:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000336d704b/0x7b5398e289bc05d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065186:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.065188:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.065189:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597176.065918:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.065927:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065937:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.065947:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.065951:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065963:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065971:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065978:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.065993:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597176.066002:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597176.066006:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066013:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597176.066016:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066023:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066033:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066050:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bda88bb9/0x7b5398e289bc05dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066062:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.066064:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.066065:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597176.066474:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.066480:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066489:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.066492:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.066495:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066506:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066513:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066520:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066534:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789597176.066541:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597176.066550:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066557:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dac00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597176.066561:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066567:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066577:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066584:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce09233f/0x7b5398e289bc05e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.066596:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.066599:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.066600:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.066900:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.066919:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.066927:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.066931:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.066939:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.066951:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.066958:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdb988f9/0x7b5398e289bc05ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.066978:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.066979:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.066981:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.066985:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.066987:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.067208:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.067210:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.067212:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597176.067749:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.067756:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.067766:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.067770:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.067774:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.067796:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.067805:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.067812:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.067835:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597176.076855:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.076870:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.076888:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.076893:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.076899:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.076914:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.076925:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.076955:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.076976:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789597176.077860:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.077868:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.077879:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.077882:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.077886:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.077897:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.077905:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.077912:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.077945:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789597176.078280:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.078286:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078302:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.078305:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.078309:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078319:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078327:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078333:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078348:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789597176.078676:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.078696:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078704:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.078707:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.078710:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078719:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078736:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078742:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.078749:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1789597176.078793:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789597176.078805:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078813:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.078818:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078828:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078845:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078853:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ef63173/0x7b5398e289bc05eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078868:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789597176.078871:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078878:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbe00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.078882:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078889:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078911:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078918:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000926566be/0x7b5398e289bc05f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078931:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789597176.078935:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078941:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.078945:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078952:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078962:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078969:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072a3b09b/0x7b5398e289bc05f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.078995:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00002000:00010000:3.0:1789597176.078997:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.078998:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079002:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079010:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.079010:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597176.079014:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.079014:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079018:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079022:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079027:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079032:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079035:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079039:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001f34658/0x7b5398e289bc0600 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079043:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079050:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597176.079053:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079060:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597176.079060:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.079063:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079069:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079078:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079089:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f138f28/0x7b5398e289bc0607 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079101:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597176.079104:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079111:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.079114:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079122:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079133:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079139:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905543b9/0x7b5398e289bc060e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.079151:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.079153:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.079155:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597176.079281:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597176.079286:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079295:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1789597176.079297:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597176.079301:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079310:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079317:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.079325:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.083780:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597176.085531:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597176.085545:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.085559:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.085563:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.085575:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.085616:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.085624:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc0615 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.085673:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.085692:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.085694:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.086747:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.087833:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597176.093586:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.093611:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.093631:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.093637:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.093643:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.093661:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.093672:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.093702:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.093723:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789597176.094137:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.094143:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.094153:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.094156:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.094159:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.094169:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.094183:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.094200:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.094223:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789597176.094995:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.095004:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095014:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.095018:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.095023:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095035:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095042:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095049:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095078:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789597176.095088:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789597176.095095:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095103:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.095109:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095119:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095137:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095144:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c0c6385/0x7b5398e289bc061c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095160:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597176.095163:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095169:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.095172:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.095173:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789597176.095180:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.095188:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1e00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.095191:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.095196:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095201:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.095205:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.095210:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc2d9c5/0x7b5398e289bc0623 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.095216:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.095223:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc062a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597176.095431:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.095434:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.095436:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.095547:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.095549:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.095550:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597176.096464:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.096476:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.096490:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.096493:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.096498:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.096510:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.096518:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.096532:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.096550:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597176.096888:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597176.096895:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.096910:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.096915:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.096924:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.096939:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.096946:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c4640f2/0x7b5398e289bc0631 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.096965:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.096967:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.096968:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.096988:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597176.097095:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.097101:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.097110:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.097113:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.097117:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.097126:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.097134:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.097142:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.097157:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597176.097165:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597176.097169:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.097182:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.097185:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.098010:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.098029:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.098037:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b135e80c/0x7b5398e289bc0638 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.098059:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.098061:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.098063:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597176.098180:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789597176.101045:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789597176.101061:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.101080:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=750s v=(0 0) 00010000:00010000:1.0:1789597176.101086:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597176.101092:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.101107:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.101123:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.101130:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.101151:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597176.101822:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597176.101831:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.101841:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a0a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.101845:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.101867:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.101885:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.101892:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000079f176d/0x7b5398e289bc063f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.101913:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.101914:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.101916:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597176.103330:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597176.103343:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.103357:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1789597176.103361:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597176.103367:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.103382:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.103400:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.103408:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.103431:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597176.103892:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597176.103901:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.103909:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.103914:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.103923:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.103940:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.103959:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000698e688c/0x7b5398e289bc0646 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.103985:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.103988:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.103990:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597176.104152:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597176.104158:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.104177:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1789597176.104181:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597176.104185:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.104194:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.104202:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.104208:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.104230:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597176.104332:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597176.104339:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.104347:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.104350:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.104357:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.104450:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.104458:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085573c45/0x7b5398e289bc064d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.104473:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.104482:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.104483:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597176.106384:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597176.106409:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.106423:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1789597176.106428:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597176.106433:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.106445:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.106476:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.106484:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.106515:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597176.106876:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597176.106883:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.106892:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dca00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.106897:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.106907:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.106929:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.106937:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006092a4d/0x7b5398e289bc0654 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.106957:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.106959:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.106961:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597176.107137:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597176.107143:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107151:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1789597176.107155:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597176.107160:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107169:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107178:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107184:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107214:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597176.107336:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597176.107343:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.107351:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dce00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.107354:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.107362:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.107374:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.107381:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004efa0b4f/0x7b5398e289bc065b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.107404:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.107405:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597176.107407:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597176.107556:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597176.107561:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107569:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1789597176.107572:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597176.107575:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107584:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107591:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107598:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.107654:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789597176.108524:0:24123:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597176.108533:0:24123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.108544:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1789597176.108553:0:24123:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597176.108558:0:24123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.108568:0:24123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.108576:0:24123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.108583:0:24123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.108952:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789597176.108960:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.108969:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dda00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597176.108974:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.108982:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.108997:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597176.109004:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78ddb65/0x7b5398e289bc0662 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597176.109385:0:24123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789597176.109693:0:24123:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1789597176.109783:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22638:x1876527984931072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98970us (99045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597176.109793:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789597176.109848:0:22638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22638:1876527984931072:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789597176.109863:0:22638:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789597176.109909:0:22638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22638:1876527984931200:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789597176.109956:0:22638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597176.109993:0:22638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb02a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789597176.110013:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931200 00000100:00100000:2.0:1789597176.110019:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931200 00000100:00100000:2.0:1789597176.110059:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597176.110074:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22638:x1876527984931200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789597176.110115:0:24122:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:1.0:1789597176.111662:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597176.111674:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.111706:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dde00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597176.111711:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.111728:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.111750:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.111756:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005df47662/0x7b5398e289bc0669 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597176.111778:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.111780:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.111782:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.112733:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.112738:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597176.112740:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789597176.116066:0:24117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1789597176.116113:0:24117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789597176.116117:0:24117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789597176.116272:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22638:x1876527984931200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6195us (6311us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789597176.116287:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789597176.116342:0:22638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789597176.116350:0:22638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22638:1876527984931200:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789597176.116365:0:22638:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:00000004:3.0:1789597176.177961:0:24592:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597176.178153:0:24592:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789597177.027124:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597178.052642:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597178.300910:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984931328:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789597178.301000:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597178.302599:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984931456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597178.302657:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597178.302731:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931456 00000100:00100000:1.0:1789597178.302740:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931456 00000100:00100000:1.0:1789597178.302788:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789597178.302797:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984931456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597178.302834:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789597178.302879:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984931456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597178.302886:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789597178.303295:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984931456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597178.303412:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23357:1876527984931584:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789597178.303447:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597178.303468:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e88928c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597178.303484:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931584 00000100:00100000:2.0:1789597178.303488:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931584 00000100:00100000:2.0:1789597178.303533:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597178.303541:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23357:x1876527984931584:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789597178.303577:0:24573:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00080000:2.0:1789597178.303753:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789597178.308602:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931328 00000100:00100000:3.0:1789597178.308618:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931328 00000100:00100000:3.0:1789597178.309862:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789597178.309881:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984931328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789597178.309922:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597178.310010:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984931328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (9010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597178.310017:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789597178.313535:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984931328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597178.343578:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23357:x1876527984931584:12345-0@lo:5:osp-pre-0-1.0 Request processed in 40030us (40122us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789597178.343592:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789597178.344464:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23357:1876527984931584:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789597178.344483:0:23357:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1789597178.344532:0:23357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23357:1876527984931712:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789597178.344578:0:23357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597178.344605:0:23357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e21ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789597178.344886:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931712 00000100:00100000:1.0:1789597178.344952:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931712 00000100:00100000:1.0:1789597178.345007:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789597178.345017:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23357:x1876527984931712:12345-0@lo:900:osp-pre-0-1.0 00010000:00080000:3.0:1789597178.345229:0:23357:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb4589180 x1876527984931712/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789597194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597178.345242:0:23357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23357:1876527984931712:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789597178.345286:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23357:x1876527984931712:12345-0@lo:900:osp-pre-0-1.0 Request processed in 124us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597178.345295:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789597178.815955:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984931840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789597178.816050:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597178.816161:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931840 00000100:00100000:1.0:1789597178.816180:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931840 00000100:00100000:1.0:1789597178.816233:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789597178.816243:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984931840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597178.816277:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597178.816333:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984931840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597178.816340:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789597178.816386:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984931840:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789597179.069996:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789597179.454710:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789597180.100496:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597181.119421:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789597181.376078:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597181.376085:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789597181.376090:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597181.376100:0:14919:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 750 00000100:00080000:3.0:1789597181.376105:0:14919:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789597181.376119:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7e867d7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597181.376169:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b4700 x1876527984932352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597181.376205:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789597181.376208:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789597181.376210:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789597181.376213:0:14919:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 750 00000100:00080000:3.0:1789597181.376216:0:14919:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789597181.376235:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7eb66a8800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597181.376248:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7d837b7b80 x1876527984932864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597181.376293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984932096:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376366:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376417:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984932736:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376441:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376466:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789597181.376472:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984931968:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376521:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984932608:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376553:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376581:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984933248:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376607:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376634:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984932224:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376673:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984932992:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376730:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376750:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789597181.376756:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984932480:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376777:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376794:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984933120:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.376815:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376836:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984932352:0@lo:8:kworker.0 00000100:00100000:3.0:1789597181.376856:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376872:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984932864:0@lo:8:kworker.0 00000100:00100000:3.0:1789597181.376891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597181.376916:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932096 00000100:00100000:3.0:1789597181.376923:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932096 00000100:00100000:3.0:1789597181.376963:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932608 00000100:00100000:3.0:1789597181.376966:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932608 00000100:00100000:3.0:1789597181.376982:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789597181.376990:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984932096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377043:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984932096:12345-0@lo:400:kworker.0 Request processed in 53us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377049:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789597181.377066:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789597181.377073:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984932608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377100:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984932608:12345-0@lo:400:kworker.0 Request processed in 28us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377106:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789597181.377125:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932736 00000100:00100000:3.0:1789597181.377129:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932736 00000100:00100000:3.0:1789597181.377167:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932224 00000100:00100000:3.0:1789597181.377170:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932224 00000100:00100000:3.0:1789597181.377183:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932352 00000100:00100000:3.0:1789597181.377185:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932352 00000100:00100000:3.0:1789597181.377194:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932864 00000100:00100000:3.0:1789597181.377197:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932864 00000100:00100000:3.0:1789597181.377205:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789597181.377211:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984932736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377242:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1876527984932736:12345-0@lo:400:kworker.0 Request processed in 32us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377248:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789597181.377259:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789597181.377264:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984932224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377296:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984932224:12345-0@lo:400:kworker.0 Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377301:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789597181.377313:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789597181.377317:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984932352:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789597181.377336:0:24123:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789597181.377384:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984932352:12345-0@lo:8:kworker.0 Request processed in 64us (526us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789597181.377390:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789597181.377401:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597181.377405:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984932864:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789597181.377413:0:24123:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789597181.377435:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984932864:12345-0@lo:8:kworker.0 Request processed in 28us (543us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789597181.377449:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597181.377467:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984931968 00000100:00100000:3.0:1789597181.377471:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984931968 00000100:00100000:3.0:1789597181.377497:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789597181.377502:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:3647:x1876527984931968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377533:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+21:3647:x1876527984931968:12345-0@lo:400:kworker.0 Request processed in 31us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377538:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789597181.377568:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984933248 00000100:00100000:3.0:1789597181.377572:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984933248 00000100:00100000:3.0:1789597181.377590:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932992 00000100:00100000:3.0:1789597181.377593:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932992 00000100:00100000:3.0:1789597181.377602:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984932480 00000100:00100000:3.0:1789597181.377605:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984932480 00000100:00100000:3.0:1789597181.377614:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984933120 00000100:00100000:3.0:1789597181.377616:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984933120 00000100:00100000:3.0:1789597181.377630:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789597181.377636:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984933248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377666:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984933248:12345-0@lo:400:kworker.0 Request processed in 30us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377672:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789597181.377706:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789597181.377711:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984932992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377739:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984932992:12345-0@lo:400:kworker.0 Request processed in 28us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377745:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789597181.377755:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789597181.377772:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984932480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377802:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984932480:12345-0@lo:400:kworker.0 Request processed in 32us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377807:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789597181.377818:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789597181.377824:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984933120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.377848:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984933120:12345-0@lo:400:kworker.0 Request processed in 25us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597181.377854:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789597181.377896:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789597181.377900:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789597181.377902:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789597181.377934:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597181.377939:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789597181.377943:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984932352:0@lo:8:kworker.0 00000100:00080000:3.0:1789597181.377952:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597181.377956:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789597181.377959:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984932864:0@lo:8:kworker.0 00010000:00080000:3.0:1789597181.377997:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b6d80 x1876527984932480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597181.378010:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984932480:0@lo:400:kworker.0 00010000:00080000:3.0:1789597181.378018:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b5c00 x1876527984933120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597181.378026:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984933120:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.378049:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984932224:0@lo:400:kworker.0 00010000:00080000:3.0:1789597181.378059:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b5f80 x1876527984932992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597181.378066:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984932992:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.378096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984931968:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.378106:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984932608:0@lo:400:kworker.0 00010000:00080000:3.0:1789597181.378115:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7d837b5500 x1876527984933248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597181.378122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984933248:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.378131:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984932096:0@lo:400:kworker.0 00000100:00100000:3.0:1789597181.378143:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984932736:0@lo:400:kworker.0 00000100:00100000:0.0:1789597181.379386:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789597181.379405:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984933376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789597181.379459:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597181.379538:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984933376 00000100:00100000:1.0:1789597181.379555:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984933376 00000100:00100000:1.0:1789597181.379611:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789597181.379620:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984933376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789597181.379646:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789597181.379728:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984933376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597181.379736:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789597181.380022:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984933376:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1789597181.896931:0:24117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00010000:00010000:1.0:1789597182.145270:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597183.165121:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597183.421071:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984933504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789597183.421159:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597183.421242:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984933504 00000100:00100000:0.0:1789597183.421260:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984933504 00000100:00100000:0.0:1789597183.421344:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789597183.421354:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984933504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789597183.421387:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789597183.426836:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984933504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5467us (5660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597183.427066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984933632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597183.427136:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597183.427215:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984933632 00000100:00100000:2.0:1789597183.427224:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984933632 00000100:00100000:2.0:1789597183.427293:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597183.427302:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984933632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789597183.427358:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597183.427404:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984933632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597183.427410:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597183.427447:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1789597183.427468:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984933632:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789597183.427578:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597183.427668:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789597183.429615:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984933504:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789597183.614282:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789597183.936375:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597183.936399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984933760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597183.936468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597183.938389:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984933760 00000100:00100000:0.0:1789597183.938404:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984933760 00000100:00100000:0.0:1789597183.938459:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789597183.938469:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984933760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789597183.938507:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597183.938592:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984933760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597183.938599:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789597183.939987:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984933760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789597184.208340:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789597184.260398:0:24939:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789597184.260402:0:24939:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789597184.260404:0:24939:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789597184.260511:0:24939:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c7d83406800 00000020:01000004:2.0:1789597184.260528:0:24939:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789597184.260544:0:24939:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789597184.260559:0:24939:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c7d83514d40) 00000020:00000080:2.0:1789597184.260578:0:24939:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789597184.355609:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789597184.368110:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789597184.368619:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789597184.369232:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789597184.369648:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789597184.371041:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789597184.374047:0:24939:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789597184.376457:0:24939:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789597184.376784:0:24939:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789597184.376801:0:24939:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789597184.376814:0:24939:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7b5398e289bc0677 00000020:01000004:2.0:1789597184.376820:0:24939:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789597184.376853:0:24939:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789597184.376856:0:24939:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789597184.376863:0:24939:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789597184.376891:0:24939:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789597184.376896:0:24939:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789597184.402534:0:24939:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789597184.402574:0:24939:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.116@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789597184.402579:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789597184.402581:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597184.402582:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597184.402583:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597184.402585:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597184.402586:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597184.402592:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597184.402594:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597184.402595:0:24939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789597184.402600:0:24939:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789597184.402602:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789597184.402603:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597184.402604:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597184.402605:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597184.402606:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597184.402607:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597184.402608:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597184.402609:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597184.402610:0:24939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789597184.402635:0:24939:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789597184.402656:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984933888:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789597184.402775:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.402820:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e917826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789597184.402972:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984933888 00000100:00100000:2.0:1789597184.402981:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984933888 00000100:00100000:2.0:1789597184.403034:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789597184.403043:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:24939:x1876527984933888:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789597184.403073:0:22608:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789597184.403077:0:22608:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789597184.403087:0:22608:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789597184.403574:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:24939:x1876527984933888:12345-0@lo:253:mount.lustre.0 Request processed in 529us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597184.403582:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789597184.404400:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984933888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789597184.404416:0:24939:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789597184.404419:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789597184.404421:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597184.404422:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597184.404423:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597184.404424:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597184.404425:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597184.404427:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597184.404428:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597184.404429:0:24939:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789597184.404448:0:24939:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c7d83406800 from lustre-OST0001 10000000:01000000:3.0:1789597184.404474:0:24939:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789597184.404477:0:24939:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789597184.404486:0:24939:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7ebbcb0000 local copy 00010000:00010000:3.0:1789597184.404496:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.404583:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597184.404639:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.404693:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e917829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789597184.404860:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934016 00000100:00100000:2.0:1789597184.404866:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934016 00000100:00100000:2.0:1789597184.404906:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789597184.404914:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:24939:x1876527984934016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597184.404999:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:24939:x1876527984934016:12345-0@lo:501:mount.lustre.0 Request processed in 87us (360us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789597184.405007:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789597184.405093:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934016:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789597184.405107:0:24939:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789597184.405126:0:24939:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789597184.405132:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.405141:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d83743000/0x7b5398e289bc02aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc02b1 expref: -99 pid: 22592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597184.405165:0:24939:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7d83406800 10000000:01000000:1.0:1789597184.405171:0:24939:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789597184.405176:0:24939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789597184.405179:0:24939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789597184.405184:0:24939:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789597184.405194:0:24939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789597184.405216:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bc067e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.405224:0:24939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bc067e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.405233:0:24939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bc067e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597184.405258:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597184.405287:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.405322:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351180 going to sleep for 11 seconds 00000100:00100000:2.0:1789597184.405477:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934144 00000100:00100000:2.0:1789597184.405481:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934144 00000100:00100000:2.0:1789597184.405513:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789597184.405520:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:24939:x1876527984934144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597184.405529:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597184.405540:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bc0685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc067e expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.405561:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bc0685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc067e expref: 22 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.405571:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dce00/0x7b5398e289bc0685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc067e expref: 22 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.405580:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dce00, rc 0) 00000100:00100000:2.0:1789597184.405609:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934144:12345-0@lo:101:mount.lustre.0 Request processed in 89us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597184.405615:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789597184.405831:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789597184.405856:0:24939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bc067e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0685 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.405864:0:24939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bc067e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0685 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789597184.408392:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1789597184.410565:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789597184.416172:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789597184.416231:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789597184.416982:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789597184.417011:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789597184.417027:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789597184.417042:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789597184.417056:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789597184.417072:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789597184.417108:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1789597184.417140:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1789597184.417147:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1789597184.417827:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597184.418274:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.418335:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351900 going to sleep for 11 seconds 00000100:00100000:2.0:1789597184.421762:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934272 00000100:00100000:2.0:1789597184.421780:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934272 00000100:00100000:2.0:1789597184.421872:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789597184.421882:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934272:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597184.422096:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934272:12345-0@lo:501:mount.lustre.0 Request processed in 215us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597184.422105:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789597184.422615:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789597184.422668:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597184.422758:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.422798:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351900 going to sleep for 11 seconds 00000100:00100000:3.0:1789597184.422886:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934400 00000100:00100000:3.0:1789597184.422891:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934400 00000100:00100000:3.0:1789597184.422924:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789597184.422931:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789597184.424097:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934400:12345-0@lo:503:mount.lustre.0 Request processed in 1161us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.424107:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789597184.424220:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789597184.424741:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789597184.424823:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597184.424885:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.424918:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351180 going to sleep for 11 seconds 00000100:00100000:3.0:1789597184.425423:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934528 00000100:00100000:3.0:1789597184.425431:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934528 00000100:00100000:3.0:1789597184.425473:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789597184.425482:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597184.425958:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934528:12345-0@lo:502:mount.lustre.0 Request processed in 476us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.425966:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789597184.426124:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597184.426635:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789597184.426666:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1789597184.426889:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1789597184.426908:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1789597184.426926:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1789597184.426940:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1789597184.426954:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1789597184.426970:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1789597184.426981:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1789597184.427024:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597184.427092:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.427140:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351180 going to sleep for 11 seconds 00000100:00100000:3.0:1789597184.427311:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934656 00000100:00100000:3.0:1789597184.427329:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934656 00000100:00100000:3.0:1789597184.427381:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789597184.427390:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789597184.427512:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934656:12345-0@lo:502:mount.lustre.0 Request processed in 122us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.427519:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789597184.429660:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597184.429799:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1789597184.429814:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789597184.441150:0:24943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789597184.441162:0:24943:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789597184.441169:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.441172:0:24943:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789597184.441179:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789597184.441196:0:24943:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c7e9e358000) 00000020:00000080:1.0:1789597184.441230:0:24943:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789597184.441238:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789597184.441368:0:24943:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d83406800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789597184.441377:0:24943:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789597184.441384:0:24943:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7b5398e289bc0693 00010000:00010000:0.0:1789597184.446832:0:24943:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789597184.450343:0:24943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1789597184.453496:0:24943:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789597184.457466:0:24943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789597184.457480:0:24943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789597184.457486:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597184.457488:0:24943:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789597184.457492:0:24943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789597184.457496:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597184.457497:0:24943:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789597184.457500:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789597184.457502:0:24943:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789597184.457504:0:24943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789597184.457506:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597184.457507:0:24943:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789597184.457509:0:24943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789597184.457511:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597184.457512:0:24943:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789597184.457516:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789597184.457547:0:24943:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789597184.457550:0:24943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789597184.457551:0:24943:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789597184.457554:0:24943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789597184.458235:0:24939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789597184.458282:0:24939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789597184.458303:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bc067e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0685 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.458336:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a1a00/0x7b5398e289bc067e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0685 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597184.458344:0:24939:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d83406800 from 1 10000000:01000000:3.0:1789597184.458347:0:24939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597184.458394:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.458403:0:24939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.458414:0:24939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.458437:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789597184.458500:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.458542:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91782900 going to sleep for 11 seconds 00000100:00100000:2.0:1789597184.459255:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934784 00000100:00100000:2.0:1789597184.459264:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934784 00000100:00100000:2.0:1789597184.459327:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789597184.459338:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:24939:x1876527984934784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789597184.459366:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597184.459379:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc069a expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.459406:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc069a expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.459418:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc069a expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.459426:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dda00, rc 0) 00000100:00100000:2.0:1789597184.459497:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984934784:12345-0@lo:101:mount.lustre.0 Request processed in 161us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597184.459503:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789597184.459654:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934784:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597184.459672:0:24939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597184.459706:0:24939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789597184.461119:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1789597184.461424:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789597184.461620:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789597184.461645:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789597184.461658:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789597184.461670:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789597184.461724:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789597184.461738:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789597184.461749:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789597184.461761:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789597184.461775:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789597184.461786:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789597184.461807:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789597184.461823:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789597184.461828:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789597184.461912:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597184.461976:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.462014:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91782540 going to sleep for 11 seconds 00000100:00100000:0.0:1789597184.462382:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984934912 00000100:00100000:0.0:1789597184.462390:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984934912 00000100:00100000:0.0:1789597184.462435:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789597184.462443:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984934912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597184.462572:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984934912:12345-0@lo:501:mount.lustre.0 Request processed in 128us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597184.462580:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789597184.464366:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984934912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789597184.464432:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789597184.464501:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.464584:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e91782540 going to sleep for 11 seconds 00000100:00100000:0.0:1789597184.481396:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935040 00000100:00100000:0.0:1789597184.481414:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935040 00000100:00100000:0.0:1789597184.481467:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789597184.481476:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984935040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597184.481638:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984935040:12345-0@lo:503:mount.lustre.0 Request processed in 162us (17136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597184.481646:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789597184.484098:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935040:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789597184.484617:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789597184.484742:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597184.484821:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597184.485042:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935168 00000100:00100000:0.0:1789597184.485049:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935168 00000100:00100000:0.0:1789597184.485100:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789597184.485109:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984935168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789597184.492974:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984935168:12345-0@lo:502:mount.lustre.0 Request processed in 7853us (8140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597184.492993:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789597184.493276:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb02a79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789597184.493303:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789597184.493634:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789597184.493669:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789597184.493934:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789597184.493949:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789597184.493961:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789597184.493971:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789597184.493982:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789597184.493993:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789597184.494012:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789597184.494023:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1789597184.494035:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1789597184.494072:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789597184.494124:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597184.494148:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb02a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597184.495358:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935296 00000100:00100000:0.0:1789597184.495370:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935296 00000100:00100000:0.0:1789597184.495425:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789597184.495435:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984935296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789597184.495648:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984935296:12345-0@lo:502:mount.lustre.0 Request processed in 214us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597184.495656:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789597184.499411:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789597184.499538:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1789597184.499553:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789597184.510641:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597184.510656:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.510658:0:24947:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789597184.510666:0:24947:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7d83406800 00000020:00000080:1.0:1789597184.510669:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789597184.510829:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597184.510833:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.510835:0:24947:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789597184.510912:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597184.510917:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.510918:0:24947:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789597184.510922:0:24947:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7d83406800 00000020:00000080:1.0:1789597184.510924:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789597184.511037:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597184.511042:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.511044:0:24947:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789597184.511046:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597184.511049:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.511073:0:24947:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789597184.511078:0:24947:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7d83406800 00000020:00000080:1.0:1789597184.511081:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789597184.523701:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597184.523879:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.523883:0:24947:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789597184.523888:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789597184.523894:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.523895:0:24947:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789597184.523900:0:24947:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7d83406800 00000020:00000080:1.0:1789597184.523903:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789597184.523978:0:24947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789597184.523982:0:24947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789597184.523984:0:24947:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789597184.523987:0:24947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1789597184.526398:0:24939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789597184.526450:0:24939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789597184.526471:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.526484:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597184.526547:0:24939:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789597184.526550:0:24939:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7d83406800 10000000:01000000:1.0:1789597184.526553:0:24939:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7d83406800 10000000:01000000:1.0:1789597184.526558:0:24939:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789597184.526565:0:24939:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7d83406800 from 1 10000000:01000000:1.0:1789597184.526567:0:24939:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789597184.526603:0:24939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bc06a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.526623:0:24939:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bc06a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.526636:0:24939:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bc06a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597184.526660:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789597184.526744:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.526782:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9e351300 going to sleep for 11 seconds 00000100:00100000:0.0:1789597184.527371:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935424 00000100:00100000:0.0:1789597184.527380:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935424 00000100:00100000:0.0:1789597184.527447:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789597184.527457:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+23:24939:x1876527984935424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597184.527473:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597184.527488:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc06af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc06a8 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597184.527513:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc06af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc06a8 expref: 24 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597184.527525:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4c00/0x7b5398e289bc06af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc06a8 expref: 24 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597184.527534:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4c00, rc 0) 00000100:00100000:0.0:1789597184.527590:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935424:12345-0@lo:101:mount.lustre.0 Request processed in 134us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597184.527596:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789597184.527661:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789597184.527702:0:24939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bc06a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06af expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597184.527714:0:24939:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bc06a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc06af expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789597184.536221:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1789597184.536619:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789597184.536844:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789597184.536869:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1789597184.536882:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1789597184.536896:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1789597184.536917:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1789597184.536928:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1789597184.536939:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1789597184.536949:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1789597184.536963:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789597184.536974:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1789597184.536986:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1789597184.536999:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1789597184.537025:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1789597184.537042:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1789597184.537056:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1789597184.537069:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1789597184.537083:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1789597184.537114:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1789597184.537129:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1789597184.537144:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1789597184.537157:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1789597184.537169:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1789597184.537180:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1789597184.537193:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1789597184.537207:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1789597184.537221:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1789597184.537233:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1789597184.542899:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1789597184.542970:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1789597184.542987:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1789597184.543000:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1789597184.543015:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1789597184.543029:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1789597184.543043:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1789597184.543059:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1789597184.543074:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1789597184.543102:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1789597184.543128:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1789597184.543144:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1789597184.543157:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1789597184.543169:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1789597184.543180:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1789597184.543191:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1789597184.543203:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1789597184.543227:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1789597184.543239:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1789597184.543267:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1789597184.543280:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1789597184.543456:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1789597184.543476:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1789597184.543493:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1789597184.543498:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1789597184.543609:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597184.543700:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597184.543750:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597184.549416:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935552 00000100:00100000:2.0:1789597184.549434:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935552 00000100:00100000:2.0:1789597184.549517:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789597184.549527:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789597184.549743:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935552:12345-0@lo:501:mount.lustre.0 Request processed in 217us (6065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597184.549750:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789597184.550236:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789597184.550366:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789597184.550423:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597184.550450:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789597184.554023:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935680 00000100:00100000:1.0:1789597184.554039:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935680 00000100:00100000:1.0:1789597184.554107:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789597184.554117:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789597184.554289:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935680:12345-0@lo:503:mount.lustre.0 Request processed in 173us (3866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.554298:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789597184.554583:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935680:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789597184.555622:0:24939:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789597184.556401:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789597184.556487:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597184.556533:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789597184.556942:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935808 00000100:00100000:1.0:1789597184.556951:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935808 00000100:00100000:1.0:1789597184.557007:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789597184.557017:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597184.557417:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935808:12345-0@lo:502:mount.lustre.0 Request processed in 400us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.557424:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789597184.557782:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597184.558072:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1789597184.558193:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1789597184.558208:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1789597184.558221:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1789597184.558233:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1789597184.558333:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1789597184.558350:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1789597184.558364:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1789597184.558376:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1789597184.558390:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1789597184.558404:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1789597184.558417:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1789597184.558431:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1789597184.558441:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1789597184.558453:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1789597184.558479:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1789597184.558494:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1789597184.558506:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1789597184.558519:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1789597184.558533:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1789597184.558546:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1789597184.558559:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1789597184.558571:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1789597184.558584:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1789597184.558598:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1789597184.558611:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1789597184.558624:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1789597184.558639:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1789597184.558654:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1789597184.558667:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1789597184.560549:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1789597184.560619:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1789597184.560636:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1789597184.560649:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1789597184.560691:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1789597184.560711:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1789597184.560725:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1789597184.560739:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1789597184.560752:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1789597184.560766:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1789597184.560779:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1789597184.560791:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1789597184.560803:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1789597184.560815:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1789597184.560827:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1789597184.560915:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1789597184.560933:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1789597184.560961:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1789597184.561023:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597184.561181:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.561231:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597184.569415:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984935936 00000100:00100000:1.0:1789597184.569433:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984935936 00000100:00100000:1.0:1789597184.569503:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789597184.569515:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597184.569707:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984935936:12345-0@lo:502:mount.lustre.0 Request processed in 194us (8526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.569715:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789597184.569788:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984935936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597184.570029:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1789597184.570058:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1789597184.570824:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984936064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597184.570908:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.570943:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e964469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597184.570967:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936064 00000100:00100000:1.0:1789597184.570973:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936064 00000100:00100000:1.0:1789597184.571009:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789597184.571017:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984936064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789597184.571360:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984936064:12345-0@lo:502:mount.lustre.0 Request processed in 343us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.571368:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789597184.571429:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984936064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789597184.571488:0:24939:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1789597184.571500:0:24939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789597184.579320:0:24952:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789597184.579339:0:24952:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c7d820c8000) 00000020:00000080:3.0:1789597184.579371:0:24952:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789597184.579474:0:24952:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d83406800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789597184.579479:0:24952:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7d83406800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789597184.579482:0:24952:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7d83406800 3 00010000:00080000:3.0:1789597184.579513:0:24952:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d82073000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:2.0:1789597184.603716:0:24952:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789597184.604412:0:24952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789597184.604473:0:24952:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789597184.604486:0:24952:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7b5398e289bc06bd 00000100:00080000:2.0:1789597184.604497:0:24952:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789597184.604510:0:24952:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c7d82073000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597184.604545:0:24952:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e867e3100 x1876527984936192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789597184.604573:0:24952:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789597184.604598:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984936192:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789597184.604629:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597184.604632:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597184.604634:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597184.604638:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 756 00000100:00080000:2.0:1789597184.604640:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789597184.604651:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7e867d7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597184.604662:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597184.604664:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7e867e2a00 x1876527984936576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789597184.604712:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597184.604715:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597184.604716:0:479:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597184.604720:0:479:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 756 00000100:00080000:2.0:1789597184.604722:0:479:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789597184.604726:0:479:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7eb66a8800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597184.604730:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984936576:0@lo:8:kworker.0 00000100:00100000:2.0:1789597184.604736:0:479:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb025f80 x1876527984937088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789597184.604753:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.604772:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984937088:0@lo:8:kworker.0 00000100:00100000:2.0:1789597184.604772:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984936320:0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.604793:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597184.604797:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.605074:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984936448:0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.605100:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.605115:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984937216:0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.605190:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.605219:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789597184.605225:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984936704:0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.605247:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.605262:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984937344:0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.605281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.605302:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936192 00000100:00100000:3.0:1789597184.605309:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936192 00000100:00100000:3.0:1789597184.605346:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937216 00000100:00100000:3.0:1789597184.605348:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937216 00000100:00100000:3.0:1789597184.605367:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936704 00000100:00100000:3.0:1789597184.605370:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936704 00000100:00100000:3.0:1789597184.605820:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937344 00000100:00100000:3.0:1789597184.605824:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937344 00000100:00100000:3.0:1789597184.605854:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789597184.605862:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984937216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.605923:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984937216:12345-0@lo:400:kworker.0 Request processed in 61us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.605930:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789597184.605948:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789597184.605953:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984936704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.605981:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984936704:12345-0@lo:400:kworker.0 Request processed in 28us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.605987:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789597184.606006:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789597184.606012:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984937344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.606038:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984937344:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.606044:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789597184.606053:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789597184.606057:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876527984936192:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789597184.606080:0:22614:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 759 last 0 00000020:00000080:3.0:1789597184.607416:0:22614:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7b5398e289bc06c4 00000004:00100000:3.0:1789597184.607435:0:22614:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789597184.607475:0:22614:0:(import.c:65:import_set_state_nolock()) ffff9c7d82076800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597184.607664:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876527984936192:12345-0@lo:38:llog_process_th.0 Request processed in 1602us (2999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.607674:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789597184.607728:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936576 00000100:00100000:3.0:1789597184.607734:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936576 00000100:00080000:1.0:1789597184.607745:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789597184.607756:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937088 00000100:00100000:3.0:1789597184.607759:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937088 00000100:00100000:1.0:1789597184.607759:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936448 00000100:00100000:1.0:1789597184.607762:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936448 00000100:00100000:3.0:1789597184.607770:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789597184.607777:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984936576:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789597184.607792:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789597184.607798:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984936448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.607823:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984936576:12345-0@lo:8:kworker.0 Request processed in 46us (3069us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789597184.607829:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789597184.607830:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984936448:12345-0@lo:400:kworker.0 Request processed in 33us (2730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.607847:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789597184.607850:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789597184.607854:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984937088:12345-0@lo:8:kworker.0 00000100:00080000:1.0:1789597184.607863:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789597184.607886:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3643:x1876527984937088:12345-0@lo:8:kworker.0 Request processed in 31us (3092us total) trans 0 rc -11/-11 00010000:00080000:1.0:1789597184.607894:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e867e1f80 x1876527984936704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597184.607905:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789597184.607908:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984936704:0@lo:400:kworker.0 00010000:00080000:1.0:1789597184.607921:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb027800 x1876527984937344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597184.607932:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789597184.607937:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1789597184.607939:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984937344:0@lo:400:kworker.0 00000100:00080000:3.0:1789597184.607941:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789597184.607944:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984937088:0@lo:8:kworker.0 00000100:00100000:3.0:1789597184.607951:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789597184.607951:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984936448:0@lo:400:kworker.0 00000100:00080000:3.0:1789597184.607954:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789597184.607958:0:3643:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789597184.607960:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984936576:0@lo:8:kworker.0 00010000:00080000:1.0:1789597184.607962:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb024a80 x1876527984937216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597184.607969:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984937216:0@lo:400:kworker.0 00010000:00080000:3.0:1789597184.607971:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7e867e3100 x1876527984936192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597184.607977:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789597184.607981:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789597184.607988:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789597184.607992:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789597184.607994:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d82073000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789597184.607999:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876527984936192:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789597184.611983:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984936960:0@lo:400:kworker.0 00000100:00100000:2.0:1789597184.612052:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597184.612095:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789597184.612102:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984936832:0@lo:400:kworker.0 00000100:00100000:2.0:1789597184.612128:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597184.612152:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984937472:0@lo:400:kworker.0 00000100:00100000:2.0:1789597184.612199:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.612262:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936320 00000100:00100000:3.0:1789597184.612271:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936320 00000100:00100000:3.0:1789597184.612323:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936832 00000100:00100000:3.0:1789597184.612327:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936832 00000100:00100000:3.0:1789597184.612344:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789597184.612353:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984936320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.612434:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984936320:12345-0@lo:400:kworker.0 Request processed in 82us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.612451:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789597184.612467:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789597184.612472:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984936832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597184.612499:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984936832:12345-0@lo:400:kworker.0 Request processed in 27us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.612505:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789597184.612958:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937472 00000100:00100000:2.0:1789597184.612964:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937472 00000100:00100000:2.0:1789597184.613014:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789597184.613022:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984937472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597184.613059:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984937472:12345-0@lo:400:kworker.0 Request processed in 39us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597184.613072:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789597184.613112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984936832:0@lo:400:kworker.0 00010000:00080000:2.0:1789597184.613124:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7ebb025500 x1876527984937472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597184.613134:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984937472:0@lo:400:kworker.0 00000100:00100000:2.0:1789597184.613144:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984936320:0@lo:400:kworker.0 00000100:00080000:2.0:1789597184.613172:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789597184.613394:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984936960 00000100:00100000:1.0:1789597184.613399:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984936960 00000100:00100000:1.0:1789597184.613440:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789597184.613447:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984936960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597184.613494:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984936960:12345-0@lo:400:kworker.0 Request processed in 47us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.613500:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789597184.613962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984936960:0@lo:400:kworker.0 00000020:01000004:3.0:1789597184.615003:0:24952:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789597184.615032:0:24952:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c7d83e099c0) 00000020:00000080:3.0:1789597184.615839:0:24952:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789597184.615942:0:24952:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c7d83406800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789597184.615947:0:24952:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7d83406800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789597184.615950:0:24952:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7d83406800 3 00010000:00080000:3.0:1789597184.615980:0:24952:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c7d82071000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.116@tcp at head 00010000:00010000:3.0:1789597184.623026:0:24952:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789597184.627650:0:24952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789597184.627733:0:24952:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789597184.627748:0:24952:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x7b5398e289bc06d2 00000100:00080000:3.0:1789597184.627761:0:24952:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789597184.627774:0:24952:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c7d82071000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:3.0:1789597184.627815:0:24952:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb458b480 x1876527984937600/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789597184.627841:0:24952:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789597184.628016:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984937600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789597184.628094:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.628280:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937600 00000100:00100000:3.0:1789597184.628288:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937600 00000100:00100000:3.0:1789597184.628335:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789597184.628342:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876527984937600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789597184.628366:0:22615:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 759 last 0 00000020:00000080:3.0:1789597184.628612:0:22615:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x7b5398e289bc06d9 00000004:00100000:3.0:1789597184.628629:0:22615:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789597184.628664:0:22615:0:(import.c:65:import_set_state_nolock()) ffff9c7d82077000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597184.628759:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876527984937600:12345-0@lo:38:llog_process_th.0 Request processed in 415us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597184.628766:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789597184.628809:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7eb458b480 x1876527984937600/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789597194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597184.628819:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789597184.628827:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1789597184.628833:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789597184.628837:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789597184.628839:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7d82071000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789597184.628845:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876527984937600:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789597184.628943:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789597184.628997:0:24939:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789597184.629024:0:24939:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789597184.629036:0:24939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bc06a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06af expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.629047:0:24939:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0600/0x7b5398e289bc06a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06af expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789597184.631372:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789597184.631377:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597184.631378:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597184.631379:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597184.631381:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597184.631387:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597184.631389:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597184.631391:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597184.631392:0:24939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789597184.631397:0:24939:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789597184.631400:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789597184.631401:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597184.631403:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597184.631404:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597184.631405:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597184.631406:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597184.631407:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597184.631408:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597184.631409:0:24939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789597184.631435:0:24939:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789597184.631457:0:24939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984937728:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789597184.631522:0:24939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.631561:0:24939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789597184.631586:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937728 00000100:00100000:3.0:1789597184.631593:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937728 00000100:00100000:3.0:1789597184.631639:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789597184.631648:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984937728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789597184.631674:0:22606:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789597184.631703:0:22606:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789597184.637119:0:22606:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789597184.637143:0:22606:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789597184.637168:0:22629:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789597184.637173:0:22629:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789597184.637196:0:22629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.637216:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 24 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.637223:0:22629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 24 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.637250:0:22629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.637294:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 24 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.637309:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 24 pid: 22608 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.637334:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984937856:0@lo:104: 00000100:00100000:3.0:1789597184.637877:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789597184.637941:0:22629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 24 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.637951:0:22629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 24 pid: 22607 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.637961:0:22629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984937984:0@lo:104: 00000100:00100000:3.0:1789597184.637983:0:22629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.638003:0:22629:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e867549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597184.638470:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937856 00000100:00100000:1.0:1789597184.638479:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937856 00000100:00100000:1.0:1789597184.638705:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984937984 00000100:00100000:1.0:1789597184.638710:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984937984 00000100:00100000:1.0:1789597184.638729:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789597184.638735:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:24939:x1876527984937728:12345-0@lo:253:mount.lustre.0 Request processed in 7088us (7213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.638738:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4588380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:22629:x1876527984937856:12345-0@lo:104: 00000100:00100000:3.0:1789597184.638746:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00010000:1.0:1789597184.638751:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.638804:0:24939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb458b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:980ee822-f655-4df0-a283-f316bd6c264b:24939:1876527984937728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789597184.638819:0:24939:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789597184.638822:0:24939:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789597184.638824:0:24939:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789597184.638825:0:24939:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789597184.638833:0:24939:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789597184.639155:0:24939:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789597184.639157:0:24939:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789597184.639159:0:24939:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789597184.639161:0:24939:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789597184.639162:0:24939:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789597184.639179:0:24939:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789597184.645835:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789597184.645855:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4588380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:22629:x1876527984937856:12345-0@lo:104: Request processed in 7111us (7972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.645882:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789597184.645917:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789597184.645929:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984937984:12345-0@lo:104: 00010000:00010000:1.0:1789597184.645949:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.646041:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789597184.646046:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:22629:x1876527984937984:12345-0@lo:104: Request processed in 123us (8062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.646052:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789597184.646077:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597184.646085:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.646092:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031a00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597184.646097:0:22602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.646106:0:22602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597184.646115:0:22602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597184.646121:0:22602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789597184.647406:0:22602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647418:0:22602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597184.647452:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647460:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031a00/0x7b5398e289bc0574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc057b expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647474:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597184.647478:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647484:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83743600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:1.0:1789597184.647488:0:22602:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647495:0:22602:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789597184.647501:0:22602:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789597184.647507:0:22602:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789597184.647525:0:22602:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647531:0:22602:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789597184.647546:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647552:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d83743600/0x7b5398e289bc0566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc056d expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647578:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597184.647579:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597184.647581:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597184.647601:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984938240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789597184.647657:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597184.647744:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984938240 00000100:00100000:1.0:1789597184.647752:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984938240 00010000:00010000:1.0:1789597184.647782:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 24 pid: 22607 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597184.647813:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789597184.647821:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+24:3644:x1876527984938240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789597184.647832:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597184.647837:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 24 pid: 22607 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647846:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 24 pid: 22607 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597184.647862:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597184.647892:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:980ee822-f655-4df0-a283-f316bd6c264b+24:3644:x1876527984938240:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597184.647899:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789597184.647933:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984938240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597184.648008:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597184.648018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984938112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597184.648045:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597184.648377:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb4589180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984937856:0@lo:104: 00010000:00010000:3.0:1789597184.648400:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031200/0x7b5398e289bc056d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc0566 expref: 23 pid: 22607 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.648418:0:22629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe1880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22629:1876527984937984:0@lo:104: 00010000:00010000:3.0:1789597184.648438:0:22629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.648462:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984938112 00000100:00100000:3.0:1789597184.648467:0:22599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984938112 00010000:00010000:3.0:1789597184.648484:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 23 pid: 22608 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.648523:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789597184.648529:0:22599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:980ee822-f655-4df0-a283-f316bd6c264b+23:3647:x1876527984938112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789597184.648538:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597184.648542:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 23 pid: 22608 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648551:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 23 pid: 22608 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648563:0:22599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc057b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc0574 expref: 23 pid: 22608 timeout: 859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648588:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648598:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789597184.648613:0:22599:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013493171s 00010000:00010000:3.0:1789597184.648617:0:22599:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648625:0:22599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648632:0:22599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648639:0:22599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648646:0:22599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:3.0:1789597184.648650:0:22599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648658:0:22599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648696:0:22599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597184.648707:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789597184.648716:0:22629:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.648723:0:22629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597184.648729:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98da400/0x7b5398e289bc06e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597184.648760:0:22599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:980ee822-f655-4df0-a283-f316bd6c264b+22:3647:x1876527984938112:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597184.648765:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984938112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789597184.648768:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:3.0:1789597184.652305:0:24939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1789597184.661181:0:24939:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789597184.661192:0:24939:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789597184.661231:0:24939:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789597184.661289:0:24939:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789597184.661306:0:24939:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789597184.661338:0:24939:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789597184.662111:0:24939:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597184.662330:0:24939:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789597185.212868:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789597185.901287:0:25006:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789597185.904423:0:25006:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789597186.239711:0:22610:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789597186.239719:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7eb98c4000 from 14 10000000:01000000:0.0:1789597186.239724:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789597186.239768:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5800/0x7b5398e289bc06e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.239780:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5800/0x7b5398e289bc06e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.239791:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5800/0x7b5398e289bc06e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597186.239814:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789597186.239876:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597186.239915:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9900 going to sleep for 11 seconds 00010000:00010000:2.0:1789597186.240615:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597186.244010:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984938368 00000100:00100000:3.0:1789597186.244025:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984938368 00000100:00100000:3.0:1789597186.244153:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789597186.244163:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+22:22610:x1876527984938368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597186.244179:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597186.244202:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc06ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc06e7 expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597186.244230:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc06ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc06e7 expref: 23 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597186.244242:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dbc00/0x7b5398e289bc06ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc06e7 expref: 23 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597186.244250:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbc00, rc 0) 00000100:00100000:3.0:1789597186.244337:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984938368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (4460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597186.244357:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789597186.249544:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597186.249575:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5800/0x7b5398e289bc06e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06ee expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.249587:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5800/0x7b5398e289bc06e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc06ee expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597186.249663:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789597186.249751:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597186.249795:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789597186.249826:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984938496 00000100:00100000:0.0:1789597186.249834:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984938496 00000100:00100000:0.0:1789597186.249881:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789597186.249897:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984938496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789597186.249920:0:22606:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789597186.249941:0:22606:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789597186.249945:0:22606:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789597186.250033:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984938496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597186.250043:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789597186.250081:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789597186.250140:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789597186.250148:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5800/0x7b5398e289bc06e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06ee expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250156:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5800/0x7b5398e289bc06e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06ee expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789597186.250168:0:22610:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789597186.250171:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7d83162800 from 14 10000000:01000000:0.0:1789597186.250174:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789597186.250197:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4e00/0x7b5398e289bc06f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250207:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4e00/0x7b5398e289bc06f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250215:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4e00/0x7b5398e289bc06f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597186.250226:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789597186.250259:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597186.250272:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789597186.250284:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984938624 00000100:00100000:0.0:1789597186.250287:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984938624 00000100:00100000:0.0:1789597186.250318:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789597186.250324:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984938624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597186.250332:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597186.250343:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e5000/0x7b5398e289bc06fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc06f5 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250368:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e5000/0x7b5398e289bc06fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc06f5 expref: 24 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250378:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e5000/0x7b5398e289bc06fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc06f5 expref: 24 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250388:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5000, rc 0) 00000100:00100000:0.0:1789597186.250415:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984938624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597186.250421:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789597186.250448:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597186.250457:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4e00/0x7b5398e289bc06f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06fc expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250464:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4e00/0x7b5398e289bc06f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc06fc expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597186.250495:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789597186.250528:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597186.250539:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9900 going to sleep for 11 seconds 00000100:00100000:0.0:1789597186.250550:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984938752 00000100:00100000:0.0:1789597186.250554:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984938752 00000100:00100000:0.0:1789597186.250574:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789597186.250581:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984938752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789597186.250589:0:22608:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789597186.250600:0:22608:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789597186.250602:0:22608:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789597186.250651:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984938752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597186.250658:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789597186.250713:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984938752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789597186.250749:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789597186.250754:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4e00/0x7b5398e289bc06f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06fc expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597186.250760:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e4e00/0x7b5398e289bc06f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc06fc expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597186.500504:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597186.500528:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984938880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597186.500609:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597186.500762:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984938880 00000100:00100000:3.0:1789597186.500771:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984938880 00000100:00100000:3.0:1789597186.500843:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789597186.500852:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984938880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789597186.500880:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597186.500935:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984938880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597186.500941:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789597186.501025:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984938880:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789597186.501157:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789597187.262006:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597188.290801:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597188.540921:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597188.540964:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984939008:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597188.541056:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597188.541211:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939008 00000100:00100000:2.0:1789597188.541222:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939008 00000100:00100000:2.0:1789597188.541312:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597188.541323:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984939008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789597188.541363:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597188.541422:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984939008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597188.541430:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789597188.541491:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984939008:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789597188.541626:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597188.548714:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789597188.548752:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984939136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597188.548854:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597188.549063:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939136 00000100:00100000:2.0:1789597188.549077:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939136 00000100:00100000:2.0:1789597188.549163:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789597188.549174:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984939136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597188.549223:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789597188.549295:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984939136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597188.549302:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789597188.549474:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984939136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597189.053829:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789597189.053863:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984939264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597189.053965:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597189.054037:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939264 00000100:00100000:1.0:1789597189.054058:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939264 00000100:00100000:1.0:1789597189.054135:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789597189.054147:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984939264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597189.054208:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597189.054292:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984939264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 147us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597189.054301:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789597189.054366:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984939264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789597189.311552:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789597189.697695:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1789597190.076923:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597190.076930:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597190.076934:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597190.076953:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c7e867d7000 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597190.076976:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7ebb027800 x1876527984939776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789597190.077025:0:14919:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789597190.077028:0:14919:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789597190.077030:0:14919:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789597190.077036:0:14919:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c7eb66a8800 using connection 192.168.202.116@tcp/0@lo 00000100:00100000:2.0:1789597190.077056:0:14919:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7eb67b5500 x1876527984940288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789597190.077113:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984939520:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.077177:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597190.077224:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984940160:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.077249:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597190.077277:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984940800:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.077304:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597190.077328:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789597190.077334:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984939648:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.077354:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597190.077370:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984940416:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.077389:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597190.077402:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984940928:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.077424:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597190.077459:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939520 00000100:00100000:2.0:1789597190.077465:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939520 00000100:00100000:2.0:1789597190.077508:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789597190.077516:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984939520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.077713:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984939392:0@lo:400:kworker.0 00000100:00100000:0.0:1789597190.077987:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940800 00000100:00100000:0.0:1789597190.077991:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940800 00000100:00100000:0.0:1789597190.078039:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940416 00000100:00100000:0.0:1789597190.078042:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940416 00000100:00100000:0.0:1789597190.078054:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940928 00000100:00100000:0.0:1789597190.078056:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940928 00000100:00100000:0.0:1789597190.078071:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789597190.078077:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984940800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597190.078159:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984939904:0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.081739:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597190.081811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984940032:0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.081855:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597190.081880:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984940672:0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.081905:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789597190.081945:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789597190.081965:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789597190.081980:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939392 00000100:00100000:1.0:1789597190.081988:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939392 00000100:00100000:1.0:1789597190.082345:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789597190.082356:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:3645:x1876527984939392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.082418:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:3645:x1876527984939392:12345-0@lo:400:kworker.0 Request processed in 64us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.082424:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789597190.082464:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940032 00000100:00100000:1.0:1789597190.082468:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940032 00000100:00100000:1.0:1789597190.082491:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789597190.082498:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984940032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.082528:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984940032:12345-0@lo:400:kworker.0 Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.082534:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789597190.082651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984939392:0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.082669:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984940032:0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.082768:0:22614:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789597190.082777:0:22614:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789597190.082796:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940160 00000100:00100000:1.0:1789597190.082800:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940160 00000100:00100000:1.0:1789597190.082834:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939648 00000100:00100000:1.0:1789597190.082837:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939648 00000100:00100000:1.0:1789597190.082856:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789597190.082862:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984940160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.082897:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984940160:12345-0@lo:400:kworker.0 Request processed in 35us (5647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.082915:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789597190.082928:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789597190.082933:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984939648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.082964:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984939648:12345-0@lo:400:kworker.0 Request processed in 31us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.082970:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789597190.082989:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984939776:0@lo:8:kworker.0 00000100:00100000:2.0:1789597190.083203:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984939520:12345-0@lo:400:kworker.0 Request processed in 5686us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597190.083211:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789597190.083250:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984939648:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.083273:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984939520:0@lo:400:kworker.0 00000100:00100000:2.0:1789597190.083297:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984940160:0@lo:400:kworker.0 00000100:00080000:0.0:1789597190.085274:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597190.085367:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984940800:12345-0@lo:400:kworker.0 Request processed in 7285us (8057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597190.085380:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789597190.085411:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940672 00000100:00100000:0.0:1789597190.085418:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940672 00000100:00080000:0.0:1789597190.085440:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789597190.085464:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789597190.085471:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984940416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597190.085521:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984940416:12345-0@lo:400:kworker.0 Request processed in 50us (8130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597190.085527:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789597190.085542:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789597190.085549:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984940928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.085692:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597190.085725:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984940288:0@lo:8:kworker.0 00000100:00100000:1.0:1789597190.085757:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597190.085791:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939776 00000100:00100000:1.0:1789597190.085796:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939776 00000100:00100000:1.0:1789597190.085815:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940288 00000100:00100000:1.0:1789597190.085817:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940288 00000100:00100000:1.0:1789597190.085828:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597190.085833:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876527984939776:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789597190.085860:0:24121:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:1.0:1789597190.085889:0:24121:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7b5398e289bc0703 00002000:00100000:1.0:1789597190.085903:0:24121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c7d84ec0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789597190.085907:0:24121:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789597190.085910:0:24121:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1789597190.086145:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b4a80 x1876527984940416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597190.086162:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984940416:0@lo:400:kworker.0 00010000:00080000:2.0:1789597190.086175:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b4e00 x1876527984940800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597190.086183:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984940800:0@lo:400:kworker.0 00000100:00100000:0.0:1789597190.086905:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984940928:12345-0@lo:400:kworker.0 Request processed in 1352us (9475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597190.086914:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789597190.086936:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789597190.086945:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984940672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597190.086987:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984940672:12345-0@lo:400:kworker.0 Request processed in 45us (5081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597190.087001:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789597190.087116:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597190.087143:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984940544:0@lo:400:kworker.0 00000100:00100000:3.0:1789597190.087169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597190.087201:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789597190.087206:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1876527984940288:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789597190.087228:0:24573:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 764 last 0 00000020:00000080:3.0:1789597190.087253:0:24573:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x7b5398e289bc070a 00002000:00100000:3.0:1789597190.087275:0:24573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c7d82076000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789597190.087281:0:24573:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789597190.087283:0:24573:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789597190.087335:0:24573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789597190.087358:0:24573:0:(import.c:65:import_set_state_nolock()) ffff9c7d82075800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597190.087400:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3643:x1876527984940288:12345-0@lo:8:kworker.0 Request processed in 192us (1641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597190.087416:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789597190.087438:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984939904 00000100:00100000:3.0:1789597190.087445:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984939904 00010000:00080000:2.0:1789597190.087524:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b6680 x1876527984940928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597190.087536:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984940928:0@lo:400:kworker.0 00002000:00080000:1.0:1789597190.088220:0:24121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789597190.088244:0:24121:0:(import.c:65:import_set_state_nolock()) ffff9c7d84ec6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597190.088302:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876527984939776:12345-0@lo:8:kworker.0 Request processed in 2467us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.088318:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597190.088365:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984940544 00000100:00100000:1.0:1789597190.088370:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984940544 00010000:00080000:0.0:1789597190.088596:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b4380 x1876527984940672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597190.088609:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984940672:0@lo:400:kworker.0 00010000:00080000:0.0:1789597190.088662:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb027800 x1876527984939776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789597190.088675:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789597190.088713:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789597190.088718:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789597190.088721:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7e867d7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789597190.088735:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789597190.088740:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876527984939776:0@lo:8:kworker.0 00010000:00080000:0.0:1789597190.088756:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b5500 x1876527984940288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789597215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789597190.088764:0:3643:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789597190.088769:0:3643:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789597190.088772:0:3643:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789597190.088774:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9c7eb66a8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789597190.088784:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789597190.088788:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876527984940288:0@lo:8:kworker.0 00000004:00080000:0.0:1789597190.088839:0:22640:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1789597190.088858:0:22640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22640:1876527984941184:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789597190.088893:0:22640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597190.088912:0:22640:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789597190.088928:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789597190.088935:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984941056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789597190.088960:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789597190.088998:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597190.090320:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941056 00000100:00100000:2.0:1789597190.090335:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941056 00000100:00100000:2.0:1789597190.090407:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789597190.090418:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984941056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789597190.090448:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789597190.090517:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876527984941056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597190.090524:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789597190.090546:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789597190.090595:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e85f09180 x1876527984941056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597190.090615:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984941056:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789597190.091171:0:23359:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789597190.091197:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23359:1876527984941440:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789597190.091242:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597190.091275:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e912f9240 going to sleep for 11 seconds 00000004:00080000:0.0:1789597190.091299:0:23358:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789597190.091392:0:23358:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 764909713311ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789597190.091399:0:23358:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789597190.091434:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941184 00000100:00100000:0.0:1789597190.091439:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941184 00000100:00100000:0.0:1789597190.091467:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941440 00000100:00100000:0.0:1789597190.091470:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941440 00000100:00100000:0.0:1789597190.091498:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789597190.091504:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22640:x1876527984941184:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789597190.091773:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789597190.091781:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23359:x1876527984941440:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789597190.091932:0:22639:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789597190.093441:0:22639:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764911760381ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789597190.093453:0:22639:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789597190.095296:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984941312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597190.095385:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789597190.095443:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597190.095458:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941312 00000100:00100000:2.0:1789597190.095467:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941312 00000100:00100000:2.0:1789597190.095511:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789597190.095521:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876527984941312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789597190.095546:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789597190.095588:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876527984941312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597190.095595:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789597190.095635:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e85f09180 x1876527984941312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597190.095657:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984941312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789597190.098644:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789597190.098669:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984939904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597190.098800:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984939904:12345-0@lo:400:kworker.0 Request processed in 144us (11684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597190.098808:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789597190.099092:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ec1fe7480 x1876527984939904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597190.099107:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984939904:0@lo:400:kworker.0 00002000:00080000:3.0:1789597190.100106:0:24121:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789597190.100116:0:24121:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789597190.100123:0:24121:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:0.0:1789597190.101937:0:23347:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1789597190.105884:0:22593:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789597190.107552:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789597190.107570:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984940544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597190.107673:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876527984940544:12345-0@lo:400:kworker.0 Request processed in 109us (20502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.107715:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789597190.107769:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb67b7800 x1876527984940544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597190.107784:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876527984940544:0@lo:400:kworker.0 00002000:00080000:1.0:1789597190.109839:0:24123:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789597190.109850:0:24123:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789597190.109946:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23359:x1876527984941440:12345-0@lo:7:osp-pre-1-1.0 Request processed in 18162us (18699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.109957:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789597190.110146:0:23359:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e85f08700 x1876527984941440/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789597206 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597190.110162:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23359:1876527984941440:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789597190.110188:0:23359:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789597190.110232:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23359:1876527984941568:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789597190.110283:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597190.110305:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e96490540 going to sleep for 11 seconds 00000100:00100000:1.0:1789597190.113079:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941568 00000100:00100000:1.0:1789597190.113100:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941568 00000100:00100000:1.0:1789597190.113178:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789597190.113188:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23359:x1876527984941568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789597190.113224:0:24122:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1789597190.113324:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23359:x1876527984941568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 137us (3040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.113332:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789597190.113384:0:23359:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e85f08700 x1876527984941568/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789597206 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597190.113418:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23359:1876527984941568:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789597190.113432:0:23359:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1789597190.113481:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23359:1876527984941696:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1789597190.113518:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597190.113544:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92d036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597190.113558:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941696 00000100:00100000:1.0:1789597190.113562:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941696 00000100:00100000:1.0:1789597190.113589:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789597190.113596:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23359:x1876527984941696:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1789597190.113625:0:24122:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1789597190.128921:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.128934:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.128952:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=764s v=(0 0) 00010000:00010000:3.0:1789597190.128957:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.128963:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.128981:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.129116:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.129127:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.129157:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597190.129829:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.129838:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.129847:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.129852:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.129862:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.129884:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.129891:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc0711 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.129911:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.129913:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.129914:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597190.138618:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597190.138634:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.138653:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=764s v=(0 0) 00010000:00010000:2.0:1789597190.138659:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597190.138666:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.138709:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.138720:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.138736:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.138758:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597190.138890:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597190.138898:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.138906:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.138912:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.138922:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.138941:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.138949:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000698e688c/0x7b5398e289bc0718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.138972:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.138973:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.138975:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597190.139464:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597190.139471:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.139481:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=764s v=(0 0) 00010000:00010000:2.0:1789597190.139484:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597190.139488:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.139497:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.139504:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.139512:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.139529:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597190.139777:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597190.139794:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.139802:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.139805:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.139813:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.139825:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.139833:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69e70fc/0x7b5398e289bc071f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.139848:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.139850:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.139851:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597190.139979:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597190.139986:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140000:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=764s v=(0 0) 00010000:00010000:2.0:1789597190.140003:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597190.140198:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140208:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140216:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140223:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140244:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597190.140491:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597190.140498:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.140518:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.140521:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.140529:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.140540:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.140547:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6a18d7b/0x7b5398e289bc0726 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.140561:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.140563:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.140565:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597190.140636:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597190.140642:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140649:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=764s v=(0 0) 00010000:00010000:2.0:1789597190.140652:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597190.140656:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140666:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140850:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.140858:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.142410:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597190.147363:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.147377:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.147396:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=764s v=(0 0) 00010000:00010000:3.0:1789597190.147401:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.147408:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.147425:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.147437:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.147445:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150387:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789597190.150404:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150418:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.150424:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150436:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150471:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150480:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc072d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150502:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597190.150508:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150514:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dba00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.150518:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150526:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150535:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.150544:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.150545:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.150548:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597190.152388:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597190.152400:0:24121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0734 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.157500:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789597190.159352:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789597190.159367:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159391:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=764s v=(0 0) 00010000:00010000:0.0:1789597190.159396:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597190.159402:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159417:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159428:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159436:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159456:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597190.159608:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.159615:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159624:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5a00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.159629:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159638:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.159668:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.162639:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cad0e8b/0x7b5398e289bc073b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.162749:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.162753:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.162756:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789597190.173000:0:24940:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1789597190.173038:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789597190.173046:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1789597190.175936:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.175951:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.175972:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=764s v=(0 0) 00010000:00010000:3.0:1789597190.175976:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.175983:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.175999:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.176138:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.176147:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.176176:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597190.176294:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597190.176302:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.176318:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dba00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.176322:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.176330:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.176359:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.176366:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.176384:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.176386:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.176388:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597190.176707:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23359:x1876527984941696:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63082us (63158us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789597190.176719:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789597190.176777:0:23359:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789597190.176787:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23359:1876527984941696:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1789597190.176804:0:23359:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1789597190.176859:0:23359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23359:1876527984941824:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789597190.176913:0:23359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597190.176938:0:23359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e92d036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597190.176961:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941824 00000100:00100000:1.0:1789597190.176969:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941824 00000100:00100000:1.0:1789597190.177035:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789597190.177044:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23359:x1876527984941824:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1789597190.177236:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.177243:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.177271:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=764s v=(0 0) 00010000:00010000:3.0:1789597190.177275:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.177280:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.177292:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.177301:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.177308:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597190.178247:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23359:x1876527984941824:12345-0@lo:900:osp-pre-1-1.0 Request processed in 1200us (1329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597190.178257:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789597190.178319:0:23359:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7ebb025f80 x1876527984941824/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789597206 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597190.178342:0:23359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23359:1876527984941824:0@lo:900:osp-pre-1-1.0 00010000:00010000:3.0:1789597190.181474:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597190.181753:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.181764:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.181780:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.181793:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.181806:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.181843:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.181850:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc0749 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.181872:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.181874:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.181876:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.182621:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.182630:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.182645:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=764s v=(0 0) 00010000:00010000:3.0:1789597190.182650:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.182656:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.182670:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.182725:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.182733:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.182754:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597190.182891:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.182898:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.182906:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.182911:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.182918:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.182933:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.182940:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc0750 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.182967:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.182969:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.182971:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.184192:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.184205:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184218:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.184222:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.184226:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184238:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184248:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184257:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184302:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597190.184648:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.184657:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.184666:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dae00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.184671:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.184704:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.184721:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.184728:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc0757 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.184745:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.184746:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.184748:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.184898:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.184904:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184913:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.184917:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.184921:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184931:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184939:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.184945:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.185002:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597190.185600:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.185609:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.185618:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.185628:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.185632:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.185640:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.185648:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.185655:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186438:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789597190.186448:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186472:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.186476:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186485:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186499:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186505:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc075e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186527:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.186530:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186535:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dba00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.186538:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186544:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186553:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.186566:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.186568:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.186570:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597190.187346:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597190.187355:0:24121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc0765 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597190.187971:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.187979:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.189773:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.189922:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.189935:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.189956:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.189976:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.189984:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.190746:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.190756:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.190768:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.190774:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.190795:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.190816:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.190826:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.190827:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.190829:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597190.197783:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597190.197809:0:24121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc076c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597190.198567:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.198575:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.198591:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.198597:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.198604:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.198619:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.198630:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.198652:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.198720:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597190.199373:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597190.199383:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.199394:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597190.199399:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.199409:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.199432:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.199440:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda88bb9/0x7b5398e289bc0773 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.199463:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.199473:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.199475:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.199601:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.199607:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.199618:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.199622:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.199627:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.199636:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.199644:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.199652:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.199719:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597190.200252:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597190.200268:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200277:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597190.200281:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200289:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200301:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200308:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000905543b9/0x7b5398e289bc077a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200322:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.200323:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.200326:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.200419:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.200425:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.200440:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.200443:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.200448:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.200458:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.200466:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.200472:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.200495:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597190.200815:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597190.200821:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200829:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597190.200832:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200846:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200858:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200864:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f138f28/0x7b5398e289bc0781 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.200878:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.200880:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.200882:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.201086:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.201092:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201100:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.201104:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.201108:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201117:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201139:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201146:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201167:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789597190.201398:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597190.201403:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.201411:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597190.201414:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.201421:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.201433:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.201451:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001f34658/0x7b5398e289bc0788 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.201464:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.201466:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.201468:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.201540:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.201546:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201554:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.201558:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.201562:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201572:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201580:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201587:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.201649:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597190.205159:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.205176:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.205195:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.205199:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.205206:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.205221:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.205233:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.205242:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.205333:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597190.205342:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.205351:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597190.205356:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.205365:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.205384:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.205392:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc078f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.205652:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.205660:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.205669:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dbe00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.205671:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.209862:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.209887:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.209900:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.209902:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.209905:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.209917:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.209919:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.209921:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597190.210162:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597190.210171:0:24121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000926566be/0x7b5398e289bc0796 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789597190.211348:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.211359:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.211380:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.211386:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.211392:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.211408:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.211417:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.211424:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.211453:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597190.211772:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597190.211781:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.211800:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.211806:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.211815:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.211831:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.211840:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ef63173/0x7b5398e289bc079d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.211860:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.211868:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.211870:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.212001:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.212007:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212015:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.212018:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.212023:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212031:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212050:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212058:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212081:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597190.212366:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.212372:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212380:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.212384:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.212388:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212396:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212403:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212410:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.212434:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789597190.212717:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789597190.212726:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212735:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98daa00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.212739:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212748:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212762:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212794:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd4cd2cd/0x7b5398e289bc07a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212818:0:24578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.212821:0:24578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212829:0:24578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.212832:0:24578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212841:0:24578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212852:0:24578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212860:0:24578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9529fa9/0x7b5398e289bc07ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.212872:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.212874:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.212875:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.212881:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.213333:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.213341:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.213350:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.213354:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.213359:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.213369:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.213377:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.213383:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.213411:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789597190.213718:0:22602:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789597190.213725:0:22602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.213734:0:22602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:1.0:1789597190.213738:0:22602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.213746:0:22602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.213758:0:22602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.213765:0:22602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c38d4d4/0x7b5398e289bc07b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597190.213782:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.213794:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.213796:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.214852:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.214864:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.214879:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.214893:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.214899:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.214915:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.214925:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.214934:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.214957:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597190.215224:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.215232:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.215246:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db600 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.215251:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.215278:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.215294:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.215301:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a92bbb6/0x7b5398e289bc07b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.215336:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.215338:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.215340:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.215769:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.216114:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.216122:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216135:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.216139:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.216144:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216156:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216164:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216180:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216202:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789597190.216445:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.216451:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.216460:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dba00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.216464:0:24577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.216472:0:24577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.216492:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.216500:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000336d704b/0x7b5398e289bc07c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.216516:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.216518:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.216520:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789597190.216739:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.216745:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216755:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.216758:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.216762:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216771:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216779:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216879:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.216898:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789597190.217234:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.217240:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.217255:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.217269:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.217275:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.217286:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.217295:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.217302:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.217911:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789597190.218430:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789597190.218438:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.218451:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=765s v=(0 0) 00010000:00010000:3.0:1789597190.218455:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789597190.218459:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.218469:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.218489:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.218497:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219000:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789597190.219532:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219546:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.219551:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219562:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219580:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219587:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b212bff7/0x7b5398e289bc07c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219626:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789597190.219630:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219637:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dae00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.219640:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219648:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219659:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.219666:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d70520b/0x7b5398e289bc07ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.221203:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789597190.221214:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.221226:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da800 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597190.221230:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.221253:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.221280:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597190.221292:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.221294:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789597190.221297:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597190.221353:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597190.226656:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789597190.226693:0:24121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a3b09b/0x7b5398e289bc07d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597190.226756:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789597190.246238:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597190.246251:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.246287:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1789597190.246292:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597190.246299:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.246314:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.246323:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.246331:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.246348:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789597190.247216:0:24121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789597190.247224:0:24121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247236:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=765s v=(0 0) 00010000:00010000:2.0:1789597190.247240:0:24121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597190.247245:0:24121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247257:0:24121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247291:0:24121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247299:0:24121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247322:0:24121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789597190.247338:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597190.247344:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247352:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dcc00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597190.247356:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247365:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247382:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247390:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8354812/0x7b5398e289bc07dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247409:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597190.247419:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247425:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dd200 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597190.247428:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247436:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247447:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247453:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b5cda5a/0x7b5398e289bc07e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597190.247466:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.247468:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597190.247469:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789597190.247523:0:24121:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:2.0:1789597190.247615:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22640:x1876527984941184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 156107us (158717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597190.247624:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789597190.247675:0:22640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f08380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22640:1876527984941184:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789597190.247710:0:22640:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789597190.247754:0:22640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22640:1876527984941952:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1789597190.248938:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597190.249149:0:22640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597190.250250:0:22640:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e81347d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789597190.250290:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984941952 00000100:00100000:2.0:1789597190.250299:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984941952 00000100:00100000:0.0:1789597190.250604:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789597190.250615:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22640:x1876527984941952:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789597190.250662:0:24123:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1789597190.256153:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22640:x1876527984941952:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5533us (7000us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789597190.256165:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789597190.260152:0:22640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b4e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22640:1876527984941952:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789597190.260176:0:22640:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1789597190.333979:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789597191.356878:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597191.613183:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789597191.613215:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984942080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789597191.613369:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597191.613548:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942080 00000100:00100000:1.0:1789597191.613559:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942080 00000100:00100000:1.0:1789597191.613626:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789597191.613637:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984942080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789597191.613703:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789597191.613809:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984942080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597191.613816:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789597191.616850:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984942080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789597192.381880:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789597192.716903:0:25297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg216-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789597193.405984:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597193.660829:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789597193.660853:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984942208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789597193.660922:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597193.660970:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942208 00000100:00100000:2.0:1789597193.660977:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942208 00000100:00100000:2.0:1789597193.661042:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789597193.661051:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984942208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789597193.661079:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597193.661119:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984942208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597193.661126:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789597193.661146:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597193.661327:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984942208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789597193.661505:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789597193.661514:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984942336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597193.661542:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597193.661572:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942336 00000100:00100000:2.0:1789597193.661576:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942336 00000100:00100000:2.0:1789597193.661605:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789597193.661610:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984942336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597193.661645:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789597193.661701:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984942336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597193.661706:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789597193.661734:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984942336:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789597193.702246:0:25349:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789597193.702476:0:25349:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1789597193.854350:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789597194.172871:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789597194.172970:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984942464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789597194.173135:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597194.173277:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942464 00000100:00100000:2.0:1789597194.173286:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942464 00000100:00100000:2.0:1789597194.173386:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789597194.173397:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984942464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789597194.173451:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597194.173507:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984942464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597194.173514:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789597194.173581:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984942464:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789597194.432208:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789597194.728712:0:25399:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789597194.728944:0:25399:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789597195.005798:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.016086:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961752448 00000100:00100000:1.0:1789597195.016100:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961752448 00000100:00100000:1.0:1789597195.016162:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:1.0:1789597195.016171:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2405:x1876527961752448:12345-192.168.202.16@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789597195.016201:0:22607:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 92535339-8580-4a0b-a747-d4b79f5081f6@192.168.202.16@tcp t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:1.0:1789597195.016239:0:22607:0:(genops.c:1384:class_connect()) connect: client 92535339-8580-4a0b-a747-d4b79f5081f6, cookie 0x7b5398e289bc07ea 00000100:00080000:1.0:1789597195.016382:0:22607:0:(import.c:65:import_set_state_nolock()) ffff9c7d84ec2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597195.016456:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+5:2405:x1876527961752448:12345-192.168.202.16@tcp:250:mount.lustre.0 Request processed in 285us (10667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.016464:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 118 00000100:00100000:1.0:1789597195.021523:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.021560:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961752576 00000100:00100000:1.0:1789597195.021569:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961752576 00000100:00100000:1.0:1789597195.021619:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:1.0:1789597195.021629:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+5:18035:x1876527961752576:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789597195.021645:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597195.021662:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a1200/0x7b5398e289bc07f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e5b expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.021708:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a1200/0x7b5398e289bc07f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e5b expref: 6 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.021735:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a1200/0x7b5398e289bc07f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e5b expref: 6 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.021756:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1200, rc 0) 00000100:00100000:1.0:1789597195.021812:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+6:18035:x1876527961752576:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 184us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.021818:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 119 00000100:00100000:1.0:1789597195.026184:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.026235:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961752704 00000100:00100000:1.0:1789597195.026246:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961752704 00000100:00100000:1.0:1789597195.026300:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:1.0:1789597195.026310:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+6:18035:x1876527961752704:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789597195.026420:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+6:18035:x1876527961752704:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 110us (244us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789597195.026428:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 120 00000100:00100000:2.0:1789597195.036396:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597195.036722:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961752832 00000100:00100000:3.0:1789597195.036734:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961752832 00000100:00100000:3.0:1789597195.036781:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:3.0:1789597195.036790:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+6:18035:x1876527961752832:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789597195.036808:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597195.036827:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bc07f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e62 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597195.036858:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bc07f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e62 expref: 7 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597195.036868:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98da800/0x7b5398e289bc07f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e62 expref: 7 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597195.036887:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da800, rc 0) 00000100:00100000:3.0:1789597195.036939:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+7:18035:x1876527961752832:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 150us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597195.036946:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 121 00000100:00100000:1.0:1789597195.046238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.046278:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961752960 00000100:00100000:1.0:1789597195.046288:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961752960 00000100:00100000:1.0:1789597195.046340:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:1.0:1789597195.046350:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+7:18035:x1876527961752960:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789597195.046510:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+8:18035:x1876527961752960:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 161us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.046518:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:3.0:1789597195.049341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597195.049604:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753088 00000100:00100000:2.0:1789597195.049615:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753088 00000100:00100000:2.0:1789597195.049748:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1789597195.049760:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+8:18035:x1876527961753088:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789597195.049934:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+8:18035:x1876527961753088:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 176us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.049941:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 123 00000100:00100000:2.0:1789597195.060627:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597195.060801:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753216 00000100:00100000:3.0:1789597195.060813:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753216 00000100:00100000:3.0:1789597195.060871:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:3.0:1789597195.060895:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+8:18054:x1876527961753216:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597195.061066:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+8:18054:x1876527961753216:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 173us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597195.061073:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 124 00000100:00100000:1.0:1789597195.092191:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597195.092274:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753344 00000100:00100000:2.0:1789597195.092286:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753344 00000100:00100000:2.0:1789597195.092392:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:2.0:1789597195.092406:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+8:18054:x1876527961753344:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789597195.092581:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+8:18054:x1876527961753344:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 178us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.092590:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 125 00000100:00100000:2.0:1789597195.107930:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597195.108046:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753472 00000100:00100000:0.0:1789597195.108056:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753472 00000100:00100000:0.0:1789597195.108106:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:0.0:1789597195.108115:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+8:18054:x1876527961753472:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789597195.108350:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+8:18054:x1876527961753472:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 235us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597195.108359:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:1.0:1789597195.114376:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597195.114509:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753600 00000100:00100000:2.0:1789597195.114520:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753600 00000100:00100000:2.0:1789597195.114580:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:2.0:1789597195.114592:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb6a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+8:18035:x1876527961753600:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789597195.114613:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597195.114633:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dc200/0x7b5398e289bc07ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e93 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597195.114664:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dc200/0x7b5398e289bc07ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e93 expref: 9 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597195.114713:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dc200/0x7b5398e289bc07ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e93 expref: 9 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597195.114725:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc200, rc 0) 00000100:00100000:2.0:1789597195.114804:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb6a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+9:18035:x1876527961753600:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 214us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.114812:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:0.0:1789597195.118860:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597195.119080:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753728 00000100:00100000:3.0:1789597195.119091:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753728 00000100:00100000:3.0:1789597195.119153:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:3.0:1789597195.119165:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+9:18035:x1876527961753728:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789597195.119191:0:22607:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789597195.119231:0:22607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789597195.119236:0:22607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789597195.119239:0:22607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789597195.119242:0:22607:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789597195.119245:0:22607:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1789597195.121452:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+9:18035:x1876527961753728:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 2280us (2594us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.121462:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 128 00000100:00100000:1.0:1789597195.126064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597195.126167:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753856 00000100:00100000:0.0:1789597195.126276:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753856 00000100:00100000:0.0:1789597195.126385:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:0.0:1789597195.126396:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+9:18035:x1876527961753856:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789597195.126415:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597195.126436:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07e9a expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597195.126469:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 10 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597195.126480:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 10 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597195.126488:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4000, rc 0) 00000100:00100000:0.0:1789597195.126562:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+10:18035:x1876527961753856:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 168us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597195.126569:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 129 00000100:00100000:3.0:1789597195.128285:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597195.128779:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961753984 00000100:00100000:2.0:1789597195.128798:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961753984 00000100:00100000:2.0:1789597195.128836:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:2.0:1789597195.128844:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+10:18035:x1876527961753984:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789597195.128983:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+10:18035:x1876527961753984:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 139us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.130058:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 130 00000100:00100000:3.0:1789597195.130641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597195.130826:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961754112 00000100:00100000:2.0:1789597195.130833:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961754112 00000100:00100000:2.0:1789597195.130879:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:2.0:1789597195.130888:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+10:18035:x1876527961754112:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789597195.131011:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+10:18035:x1876527961754112:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 124us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.131018:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 131 00000100:00100000:3.0:1789597195.132953:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597195.133161:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961754240 00000100:00100000:2.0:1789597195.133169:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961754240 00000100:00100000:2.0:1789597195.133233:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:2.0:1789597195.133242:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+10:18060:x1876527961754240:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789597195.133364:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+10:18060:x1876527961754240:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 123us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.133372:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 132 00000100:00100000:3.0:1789597195.147857:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.147956:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961754368 00000100:00100000:1.0:1789597195.147964:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961754368 00000100:00100000:1.0:1789597195.148022:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:1.0:1789597195.148034:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+10:18060:x1876527961754368:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789597195.148231:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+10:18060:x1876527961754368:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 199us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.148237:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 133 00000100:00100000:3.0:1789597195.156075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597195.156276:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961754496 00000100:00100000:0.0:1789597195.156289:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961754496 00000100:00100000:0.0:1789597195.156339:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1789597195.156348:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1876527961754496:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789597195.156383:0:22615:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7df745ac-3f71-492a-842b-2e7c88612cac@192.168.202.16@tcp t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:0.0:1789597195.156443:0:22615:0:(genops.c:1384:class_connect()) connect: client 7df745ac-3f71-492a-842b-2e7c88612cac, cookie 0x7b5398e289bc080d 00000004:00100000:0.0:1789597195.156472:0:22615:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789597195.156713:0:22615:0:(import.c:65:import_set_state_nolock()) ffff9c7d833eb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597195.156788:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+6:2405:x1876527961754496:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 439us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597195.156796:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1789597195.160470:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.160559:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961754752 00000100:00100000:1.0:1789597195.160568:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961754752 00000100:00100000:1.0:1789597195.160607:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1789597195.160613:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2405:x1876527961754752:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789597195.160639:0:22614:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7df745ac-3f71-492a-842b-2e7c88612cac@192.168.202.16@tcp t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:1.0:1789597195.160716:0:22614:0:(genops.c:1384:class_connect()) connect: client 7df745ac-3f71-492a-842b-2e7c88612cac, cookie 0x7b5398e289bc0814 00000004:00100000:1.0:1789597195.160740:0:22614:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789597195.160960:0:22614:0:(import.c:65:import_set_state_nolock()) ffff9c7d84ec1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789597195.161027:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+6:2405:x1876527961754752:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 412us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.161036:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:3.0:1789597195.165562:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597195.165597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597195.165675:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755008 00000100:00100000:0.0:1789597195.165713:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755008 00000100:00080000:2.0:1789597195.165759:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789597195.165775:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961754624 00000100:00100000:0.0:1789597195.165778:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961754624 00000100:00100000:0.0:1789597195.165807:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789597195.165817:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+7:18035:x1876527961755008:12345-192.168.202.16@tcp:41:mount.lustre.0 00000100:00100000:2.0:1789597195.165856:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789597195.165865:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+7:0:x1876527961754624:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789597195.165878:0:22613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000004:00000024:2.0:1789597195.165890:0:25157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789597195.165972:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+7:18035:x1876527961755008:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 155us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597195.165979:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:2.0:1789597195.166071:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+6:0:x1876527961754624:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 207us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.166084:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:3.0:1789597195.168808:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597195.168927:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755136 00000100:00100000:0.0:1789597195.168937:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755136 00000100:00100000:0.0:1789597195.168999:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789597195.169008:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+6:18035:x1876527961755136:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789597195.169145:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+6:18035:x1876527961755136:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 138us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597195.169153:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:0.0:1789597195.170840:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.170924:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961754880 00000100:00100000:1.0:1789597195.170933:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961754880 00000100:00100000:1.0:1789597195.170995:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00080000:2.0:1789597195.170997:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789597195.171005:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+6:0:x1876527961754880:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789597195.171051:0:22615:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597195.171133:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+6:0:x1876527961754880:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 129us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.171141:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:3.0:1789597195.173461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597195.173511:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597195.173529:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755264 00000100:00100000:2.0:1789597195.173538:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755264 00000100:00100000:2.0:1789597195.173582:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755392 00000100:00100000:2.0:1789597195.173585:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755392 00000100:00100000:2.0:1789597195.173662:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789597195.173671:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1876527961755264:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789597195.173735:0:24122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7df745ac-3f71-492a-842b-2e7c88612cac@192.168.202.16@tcp t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:2.0:1789597195.173775:0:24122:0:(genops.c:1384:class_connect()) connect: client 7df745ac-3f71-492a-842b-2e7c88612cac, cookie 0x7b5398e289bc081b 00002000:00100000:2.0:1789597195.173787:0:24122:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7df745ac-3f71-492a-842b-2e7c88612cac/ffff9c7eb7f13000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789597195.173798:0:24122:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789597195.174032:0:24122:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789597195.174067:0:24122:0:(import.c:65:import_set_state_nolock()) ffff9c7eb7f10000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597195.174139:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7df745ac-3f71-492a-842b-2e7c88612cac+6:2405:x1876527961755264:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 468us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.174147:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789597195.174167:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789597195.174172:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2405:x1876527961755392:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789597195.174189:0:24122:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7df745ac-3f71-492a-842b-2e7c88612cac@192.168.202.16@tcp t0 exp 0000000000000000 cur 769 last 0 00000020:00000080:2.0:1789597195.174206:0:24122:0:(genops.c:1384:class_connect()) connect: client 7df745ac-3f71-492a-842b-2e7c88612cac, cookie 0x7b5398e289bc0822 00002000:00100000:2.0:1789597195.174211:0:24122:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7df745ac-3f71-492a-842b-2e7c88612cac/ffff9c7eb7f16800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789597195.174243:0:24122:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789597195.174363:0:24122:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789597195.174396:0:24122:0:(import.c:65:import_set_state_nolock()) ffff9c7eb7f16000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789597195.174422:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7df745ac-3f71-492a-842b-2e7c88612cac+6:2405:x1876527961755392:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 248us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.174429:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:2.0:1789597195.179496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597195.181768:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755520 00000100:00100000:3.0:1789597195.181784:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755520 00000100:00100000:3.0:1789597195.181844:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789597195.181855:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7df745ac-3f71-492a-842b-2e7c88612cac+6:18035:x1876527961755520:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789597195.181963:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7df745ac-3f71-492a-842b-2e7c88612cac+6:18035:x1876527961755520:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 109us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597195.181971:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000001:00100000:1.0:1789597195.183436:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7df745ac-3f71-492a-842b-2e7c88612cac 00000001:00080000:1.0:1789597195.183452:0:24940:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1789597195.186938:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.187132:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755648 00000100:00100000:1.0:1789597195.187144:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755648 00000100:00100000:1.0:1789597195.187286:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:1.0:1789597195.187298:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+6:18035:x1876527961755648:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789597195.190295:0:22616:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2750us 00000100:00100000:3.0:1789597195.199298:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ec1fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984942592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789597195.199384:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597195.199465:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942592 00000100:00100000:3.0:1789597195.199473:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942592 00000100:00100000:3.0:1789597195.199547:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789597195.199557:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984942592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789597195.199582:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789597195.199635:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984942592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597195.199643:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789597195.199664:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789597195.199714:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1789597195.199752:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ec1fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984942592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789597195.200726:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984942848:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.200774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597195.200808:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984943360:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.200831:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597195.200850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984943872:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.200873:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597195.200895:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789597195.200900:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984942976:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.200920:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597195.200935:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984943488:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.200954:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597195.200970:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984944000:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.200991:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597195.201032:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942848 00000100:00100000:1.0:1789597195.201038:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942848 00000100:00100000:1.0:1789597195.201076:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789597195.201084:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984942848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201131:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984942848:12345-0@lo:400:kworker.0 Request processed in 48us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.201137:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789597195.201157:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984943872 00000100:00100000:1.0:1789597195.201160:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984943872 00000100:00100000:1.0:1789597195.201188:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944000 00000100:00100000:1.0:1789597195.201191:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944000 00000100:00100000:1.0:1789597195.201222:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789597195.201229:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984943872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201260:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876527984943872:12345-0@lo:400:kworker.0 Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.201265:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789597195.201277:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789597195.201284:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984944000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201309:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876527984944000:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.201314:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789597195.201345:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e869bed80 x1876527984944000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597195.201356:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876527984944000:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201366:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984942848:0@lo:400:kworker.0 00010000:00080000:1.0:1789597195.201374:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e869be300 x1876527984943872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597195.201389:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876527984943872:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201424:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984943360 00000100:00100000:1.0:1789597195.201428:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984943360 00000100:00100000:1.0:1789597195.201454:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942976 00000100:00100000:1.0:1789597195.201456:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942976 00000100:00100000:1.0:1789597195.201466:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984943488 00000100:00100000:1.0:1789597195.201469:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984943488 00000100:00100000:1.0:1789597195.201482:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789597195.201488:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984943360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201524:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984943360:12345-0@lo:400:kworker.0 Request processed in 36us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.201529:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789597195.201541:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789597195.201547:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984942976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201573:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984942976:12345-0@lo:400:kworker.0 Request processed in 27us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.201578:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789597195.201589:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789597195.201594:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984943488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201621:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984943488:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.201627:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789597195.201653:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984942976:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201663:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984943488:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.201671:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984943360:0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.202014:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984942720:0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.202056:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597195.202084:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984943232:0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.202107:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597195.202124:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984943744:0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.202144:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597195.202162:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789597195.202167:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984943104:0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.202186:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597195.202199:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984943616:0@lo:400:kworker.0 00000100:00100000:3.0:1789597195.203026:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984943744 00000100:00100000:3.0:1789597195.203035:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984943744 00000100:00100000:3.0:1789597195.203081:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984943104 00000100:00100000:3.0:1789597195.203084:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984943104 00000100:00100000:3.0:1789597195.203101:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789597195.203107:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984943744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597195.203158:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876527984943744:12345-0@lo:400:kworker.0 Request processed in 51us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597195.203164:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789597195.203179:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789597195.203184:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984943104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597195.203211:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984943104:12345-0@lo:400:kworker.0 Request processed in 26us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597195.203229:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789597195.203245:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789597195.203251:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789597195.203254:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789597195.203256:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789597195.203351:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984942720 00000100:00100000:1.0:1789597195.203355:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984942720 00000100:00100000:1.0:1789597195.203391:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789597195.203398:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+24:3647:x1876527984942720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.203433:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d41c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+24:3647:x1876527984942720:12345-0@lo:400:kworker.0 Request processed in 36us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.203439:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789597195.203581:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597195.203607:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984944128:0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.203706:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597195.203731:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984942720:0@lo:400:kworker.0 00010000:00080000:2.0:1789597195.203745:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e867e1f80 x1876527984943744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597195.203756:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876527984943744:0@lo:400:kworker.0 00010000:00080000:2.0:1789597195.203779:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e867e2680 x1876527984943104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597195.203802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984943104:0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.203825:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984943232 00000100:00100000:2.0:1789597195.203828:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984943232 00000100:00100000:2.0:1789597195.203854:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789597195.203861:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984943232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597195.203900:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984943232:12345-0@lo:400:kworker.0 Request processed in 40us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.203906:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789597195.203932:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984943232:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.204709:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984943616 00000100:00100000:1.0:1789597195.204716:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984943616 00000100:00100000:1.0:1789597195.204744:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944128 00000100:00100000:1.0:1789597195.204747:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944128 00000100:00100000:1.0:1789597195.204773:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789597195.204780:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984943616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.204831:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984943616:12345-0@lo:400:kworker.0 Request processed in 51us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.204836:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789597195.204848:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789597195.204854:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984944128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.204877:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984944128:12345-0@lo:400:kworker.0 Request processed in 24us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.204882:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789597195.204896:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789597195.204928:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e867e3800 x1876527984943616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597195.204939:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984943616:0@lo:400:kworker.0 00010000:00080000:1.0:1789597195.204952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7e869bdc00 x1876527984944128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789597195.204967:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984944128:0@lo:400:kworker.0 00000100:00100000:1.0:1789597195.206604:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984944256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597195.206667:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597195.211968:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944256 00000100:00100000:0.0:1789597195.211986:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944256 00000100:00100000:0.0:1789597195.212130:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789597195.212144:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984944256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789597195.212172:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1789597195.212266:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984944256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597195.212273:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00200000:2.0:1789597195.212659:0:22616:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789597195.212797:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+6:18035:x1876527961755648:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 25499us (25865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597195.212811:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789597195.213396:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83696a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984944256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597195.404743:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597195.404869:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755776 00000100:00100000:1.0:1789597195.404883:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755776 00000100:00100000:1.0:1789597195.404967:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:1.0:1789597195.404980:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+6:18083:x1876527961755776:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:1.0:1789597195.405004:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597195.405108:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0a00/0x7b5398e289bc0829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ecb expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.405190:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bc0830 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.405205:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bc0830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.405288:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bc0830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597195.405342:0:22614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789597195.405346:0:22614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789597195.405520:0:22614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bc0830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.405550:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0a00/0x7b5398e289bc0829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ecb expref: 8 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.405589:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bc0830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ecb expref: 7 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597195.405599:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:1.0:1789597195.405602:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789597195.405605:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0c00, rc 0) 00000100:00100000:1.0:1789597195.405844:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+7:18083:x1876527961755776:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 866us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597195.405852:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00010000:00010000:3.0:1789597195.454184:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789597196.477827:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597196.733421:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789597196.733460:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984944384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789597196.733566:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597196.733980:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944384 00000100:00100000:1.0:1789597196.733994:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944384 00000100:00100000:1.0:1789597196.734054:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789597196.734062:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984944384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789597196.734100:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789597196.734162:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984944384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597196.734171:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789597196.734288:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984944384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789597197.500938:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597197.551141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597197.551305:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961755904 00000100:00100000:2.0:1789597197.551322:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961755904 00000100:00080000:1.0:1789597197.551398:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597197.551421:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:2.0:1789597197.551435:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+7:18135:x1876527961755904:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:2.0:1789597197.551491:0:22613:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789597197.551616:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+7:18135:x1876527961755904:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 184us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597197.551624:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:3.0:1789597197.554041:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597197.557325:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756032 00000100:00100000:1.0:1789597197.557345:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756032 00000100:00100000:1.0:1789597197.557442:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:1.0:1789597197.557456:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+6:18135:x1876527961756032:12345-192.168.202.16@tcp:41:lfs.0 00000004:00000024:1.0:1789597197.557502:0:22614:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597197.557647:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+6:18135:x1876527961756032:12345-192.168.202.16@tcp:41:lfs.0 Request processed in 194us (3614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597197.557654:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:3.0:1789597197.558529:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789597197.561179:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597197.561486:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756160 00000100:00100000:1.0:1789597197.561496:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756160 00000100:00100000:1.0:1789597197.561573:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:1.0:1789597197.561584:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7df745ac-3f71-492a-842b-2e7c88612cac+6:18135:x1876527961756160:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:1.0:1789597197.561609:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789597197.561776:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7df745ac-3f71-492a-842b-2e7c88612cac+6:18135:x1876527961756160:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 193us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597197.561784:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00080000:3.0:1789597197.562219:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597197.564433:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597197.564551:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756288 00000100:00100000:3.0:1789597197.564560:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756288 00000100:00100000:3.0:1789597197.564623:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:3.0:1789597197.564632:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7df745ac-3f71-492a-842b-2e7c88612cac+5:18135:x1876527961756288:12345-192.168.202.16@tcp:13:lfs.0 00002000:00000024:3.0:1789597197.564711:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789597197.564807:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7df745ac-3f71-492a-842b-2e7c88612cac+5:18135:x1876527961756288:12345-192.168.202.16@tcp:13:lfs.0 Request processed in 175us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597197.564815:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:1.0:1789597197.565760:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597197.846449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597197.846786:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756416 00000100:00100000:3.0:1789597197.846798:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756416 00000100:00100000:3.0:1789597197.846862:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:3.0:1789597197.846943:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+10:18169:x1876527961756416:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789597197.846963:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597197.846983:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bc0837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ed2 expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.847015:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bc0837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ed2 expref: 11 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.847029:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dbe00/0x7b5398e289bc0837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ed2 expref: 11 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.847039:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dbe00, rc 0) 00000100:00100000:3.0:1789597197.847160:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+11:18169:x1876527961756416:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 222us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597197.847168:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 135 00000100:00100000:3.0:1789597197.860796:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597197.861013:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756544 00000100:00100000:1.0:1789597197.861025:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756544 00000100:00100000:1.0:1789597197.861087:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:1.0:1789597197.861108:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+11:18169:x1876527961756544:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789597197.861304:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+11:18169:x1876527961756544:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 207us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597197.861312:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 136 00000100:00100000:0.0:1789597197.863967:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597197.877028:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756672 00000100:00100000:1.0:1789597197.877048:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756672 00000100:00100000:1.0:1789597197.877132:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:1.0:1789597197.877143:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+11:18169:x1876527961756672:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789597197.878137:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+11:18169:x1876527961756672:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 988us (14173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597197.878147:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 137 00000100:00100000:2.0:1789597197.894255:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597197.896495:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756800 00000100:00100000:3.0:1789597197.896511:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756800 00000100:00100000:3.0:1789597197.896629:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:3.0:1789597197.896640:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+11:18175:x1876527961756800:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597197.896863:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83d40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+11:18175:x1876527961756800:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 224us (2615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597197.897147:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 138 00000100:00100000:3.0:1789597197.931528:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597197.931660:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961756928 00000100:00100000:1.0:1789597197.931674:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961756928 00000100:00100000:1.0:1789597197.931846:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:1.0:1789597197.931857:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+11:18175:x1876527961756928:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789597197.932080:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+11:18175:x1876527961756928:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 223us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597197.932089:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:2.0:1789597197.943652:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597197.944107:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757056 00000100:00100000:3.0:1789597197.944126:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757056 00000100:00100000:3.0:1789597197.944218:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:3.0:1789597197.944232:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+11:18175:x1876527961757056:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597197.944460:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ea1cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+11:18175:x1876527961757056:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 231us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597197.944469:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 140 00000100:00100000:2.0:1789597197.951448:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597197.951791:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757184 00000100:00100000:3.0:1789597197.951802:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757184 00000100:00100000:3.0:1789597197.951864:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:3.0:1789597197.953025:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+11:18169:x1876527961757184:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789597197.953043:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597197.953061:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bc083e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f03 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.953090:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bc083e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f03 expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.953100:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db000/0x7b5398e289bc083e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f03 expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.953109:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db000, rc 0) 00000100:00100000:3.0:1789597197.953200:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+12:18169:x1876527961757184:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 179us (1755us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597197.953208:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:0.0:1789597197.958905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597197.958992:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757312 00000100:00100000:1.0:1789597197.959010:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757312 00000100:00100000:1.0:1789597197.959090:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:1.0:1789597197.959103:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+12:18169:x1876527961757312:12345-192.168.202.16@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789597197.959138:0:22608:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789597197.959174:0:22608:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789597197.959179:0:22608:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789597197.959182:0:22608:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789597197.959185:0:22608:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789597197.959196:0:22608:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789597197.961508:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+12:18169:x1876527961757312:12345-192.168.202.16@tcp:256:mount.lustre.0 Request processed in 2393us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597197.961526:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 142 00000100:00100000:2.0:1789597197.965298:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597197.965452:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757440 00000100:00100000:3.0:1789597197.965464:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757440 00000100:00100000:3.0:1789597197.965521:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:3.0:1789597197.965532:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+12:18169:x1876527961757440:12345-192.168.202.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789597197.965549:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597197.965566:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f0a expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.965595:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 13 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.965608:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 13 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597197.965617:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db200, rc 0) 00000100:00100000:3.0:1789597197.965707:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+13:18169:x1876527961757440:12345-192.168.202.16@tcp:101:mount.lustre.0 Request processed in 177us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597197.965716:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 143 00000100:00100000:0.0:1789597197.981169:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597197.981333:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757568 00000100:00100000:1.0:1789597197.981347:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757568 00000100:00100000:1.0:1789597197.981409:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:1.0:1789597197.981420:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:18169:x1876527961757568:12345-192.168.202.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789597197.987836:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:18169:x1876527961757568:12345-192.168.202.16@tcp:501:mount.lustre.0 Request processed in 6400us (6658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597197.987853:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 144 00000100:00100000:1.0:1789597197.997428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597197.997810:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757696 00000100:00100000:2.0:1789597197.997821:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757696 00000100:00100000:2.0:1789597197.997893:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:2.0:1789597197.997905:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+13:18169:x1876527961757696:12345-192.168.202.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789597197.998075:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+13:18169:x1876527961757696:12345-192.168.202.16@tcp:503:mount.lustre.0 Request processed in 171us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597197.998082:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 145 00000100:00100000:2.0:1789597198.002915:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597198.003384:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757824 00000100:00100000:1.0:1789597198.003396:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757824 00000100:00100000:1.0:1789597198.003474:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:1.0:1789597198.003484:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:18180:x1876527961757824:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789597198.003644:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:18180:x1876527961757824:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 160us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597198.003652:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 146 00000100:00100000:0.0:1789597198.014049:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597198.014155:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961757952 00000100:00100000:3.0:1789597198.014167:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961757952 00000100:00100000:3.0:1789597198.014245:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:3.0:1789597198.014256:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+13:18180:x1876527961757952:12345-192.168.202.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789597198.014436:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+13:18180:x1876527961757952:12345-192.168.202.16@tcp:502:llog_process_th.0 Request processed in 181us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597198.014454:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 147 00000100:00100000:3.0:1789597198.019270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597198.019315:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597198.019344:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597198.019377:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597198.019399:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597198.019421:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597198.019563:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758080 00000100:00100000:0.0:1789597198.019574:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758080 00000100:00100000:0.0:1789597198.019606:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758336 00000100:00100000:0.0:1789597198.019609:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758336 00000100:00100000:0.0:1789597198.019618:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758720 00000100:00100000:0.0:1789597198.019620:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758720 00000100:00100000:0.0:1789597198.019642:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758848 00000100:00100000:0.0:1789597198.019645:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758848 00000100:00100000:0.0:1789597198.019662:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789597198.019671:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+7:2407:x1876527961758720:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597198.019794:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+7:2407:x1876527961758720:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 123us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.019802:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:0.0:1789597198.019820:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:0.0:1789597198.019827:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+6:2407:x1876527961758848:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597198.019851:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+6:2407:x1876527961758848:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.019857:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:0.0:1789597198.019881:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789597198.019886:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1876527961758080:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789597198.019910:0:22615:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from be7b4031-1e67-4349-a0a6-83f95986ed0a@192.168.202.16@tcp t0 exp 0000000000000000 cur 772 last 0 00000020:00000080:0.0:1789597198.019947:0:22615:0:(genops.c:1384:class_connect()) connect: client be7b4031-1e67-4349-a0a6-83f95986ed0a, cookie 0x7b5398e289bc084c 00000004:00100000:0.0:1789597198.019973:0:22615:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789597198.020061:0:22615:0:(import.c:65:import_set_state_nolock()) ffff9c7d833ea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597198.020109:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2405:x1876527961758080:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 207us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.020129:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:0.0:1789597198.020145:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789597198.020149:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2405:x1876527961758336:12345-192.168.202.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789597198.020164:0:22615:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from be7b4031-1e67-4349-a0a6-83f95986ed0a@192.168.202.16@tcp t0 exp 0000000000000000 cur 772 last 0 00000020:00000080:0.0:1789597198.020211:0:22615:0:(genops.c:1384:class_connect()) connect: client be7b4031-1e67-4349-a0a6-83f95986ed0a, cookie 0x7b5398e289bc0853 00000004:00100000:0.0:1789597198.020235:0:22615:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789597198.020279:0:22615:0:(import.c:65:import_set_state_nolock()) ffff9c7eb7f01000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789597198.020304:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2405:x1876527961758336:12345-192.168.202.16@tcp:38:mount.lustre.0 Request processed in 151us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.020310:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:1.0:1789597198.022007:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758976 00000100:00100000:1.0:1789597198.022021:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758976 00000100:00100000:1.0:1789597198.022088:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961759104 00000100:00100000:1.0:1789597198.022092:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961759104 00000100:00100000:1.0:1789597198.022127:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789597198.022137:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+6:2407:x1876527961758976:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789597198.022209:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+6:2407:x1876527961758976:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597198.022216:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789597198.022245:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1789597198.022253:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ec1fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+5:2407:x1876527961759104:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789597198.022279:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ec1fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+5:2407:x1876527961759104:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 28us (2857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597198.022285:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1789597198.035728:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597198.035751:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597198.035821:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758464 00000100:00100000:0.0:1789597198.035831:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758464 00000100:00100000:0.0:1789597198.035903:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758208 00000100:00100000:0.0:1789597198.035906:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758208 00000100:00100000:0.0:1789597198.035928:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789597198.035938:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:0:x1876527961758464:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789597198.035970:0:22615:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789597198.036031:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:0:x1876527961758464:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 96us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.036037:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789597198.036052:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:0.0:1789597198.036056:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:0:x1876527961758208:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789597198.036064:0:22615:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789597198.036081:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:0:x1876527961758208:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.036097:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00080000:3.0:1789597198.036595:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789597198.036600:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789597198.036721:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597198.037145:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961758592 00000100:00100000:3.0:1789597198.037152:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961758592 00000100:00100000:0.0:1789597198.037432:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:0.0:1789597198.037442:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961758592:12345-192.168.202.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789597198.037466:0:22615:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789597198.037527:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961758592:12345-192.168.202.16@tcp:41:mount.lustre.0 Request processed in 86us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.037534:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:0.0:1789597198.046496:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597198.046595:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961759232 00000100:00100000:2.0:1789597198.046606:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961759232 00000100:00100000:2.0:1789597198.046722:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789597198.046735:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961759232:12345-192.168.202.16@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789597198.046839:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961759232:12345-192.168.202.16@tcp:40:mount.lustre.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597198.046848:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:2.0:1789597198.051586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597198.051626:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597198.051662:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597198.051904:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961759616 00000100:00100000:1.0:1789597198.051915:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961759616 00000100:00100000:3.0:1789597198.052161:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961759360 00000100:00100000:3.0:1789597198.052167:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961759360 00000100:00100000:3.0:1789597198.052202:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961759488 00000100:00100000:3.0:1789597198.052206:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961759488 00000100:00100000:3.0:1789597198.052241:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789597198.052250:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2405:x1876527961759360:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789597198.052283:0:24573:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from be7b4031-1e67-4349-a0a6-83f95986ed0a@192.168.202.16@tcp t0 exp 0000000000000000 cur 772 last 0 00000020:00000080:3.0:1789597198.052312:0:24573:0:(genops.c:1384:class_connect()) connect: client be7b4031-1e67-4349-a0a6-83f95986ed0a, cookie 0x7b5398e289bc085a 00002000:00100000:3.0:1789597198.052323:0:24573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli be7b4031-1e67-4349-a0a6-83f95986ed0a/ffff9c7e859ed800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789597198.052334:0:24573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789597198.052401:0:24573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789597198.052432:0:24573:0:(import.c:65:import_set_state_nolock()) ffff9c7e859ee000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597198.052494:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2405:x1876527961759360:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 244us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597198.052501:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789597198.052538:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789597198.052543:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2405:x1876527961759488:12345-192.168.202.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789597198.052558:0:24573:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from be7b4031-1e67-4349-a0a6-83f95986ed0a@192.168.202.16@tcp t0 exp 0000000000000000 cur 772 last 0 00000020:00000080:3.0:1789597198.052574:0:24573:0:(genops.c:1384:class_connect()) connect: client be7b4031-1e67-4349-a0a6-83f95986ed0a, cookie 0x7b5398e289bc0861 00002000:00100000:3.0:1789597198.052579:0:24573:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli be7b4031-1e67-4349-a0a6-83f95986ed0a/ffff9c7d82072800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789597198.052585:0:24573:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789597198.052625:0:24573:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789597198.052638:0:24573:0:(import.c:65:import_set_state_nolock()) ffff9c7d82077800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789597198.052662:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2405:x1876527961759488:12345-192.168.202.16@tcp:8:mount.lustre.0 Request processed in 118us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597198.052709:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:1.0:1789597198.053719:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:1.0:1789597198.053738:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961759616:12345-192.168.202.16@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789597198.053815:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961759616:12345-192.168.202.16@tcp:900:mount.lustre.0 Request processed in 85us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597198.053839:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789597198.065284:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597198.065450:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961759744 00000100:00100000:1.0:1789597198.065460:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961759744 00000100:00100000:1.0:1789597198.065516:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:1.0:1789597198.065527:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961759744:12345-192.168.202.16@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789597198.065619:0:22617:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789597198.065745:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18169:x1876527961759744:12345-192.168.202.16@tcp:33:mount.lustre.0 Request processed in 219us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597198.065753:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:0.0:1789597198.253047:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597198.253181:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961759872 00000100:00100000:1.0:1789597198.253205:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961759872 00000100:00100000:1.0:1789597198.253286:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 22 00000100:00100000:1.0:1789597198.253298:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18203:x1876527961759872:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:1.0:1789597198.253326:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597198.253355:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc0868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f3b expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597198.253460:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597198.253476:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597198.253492:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597198.253544:0:22614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789597198.253566:0:22614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789597198.253592:0:22614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597198.253625:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc0868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 8 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597198.253653:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 7 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597198.253674:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:1.0:1789597198.253733:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789597198.253739:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0800, rc 0) 00000100:00100000:1.0:1789597198.253825:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+7:18203:x1876527961759872:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 529us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597198.253836:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 22 00010000:00010000:2.0:1789597198.525000:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597198.780903:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597198.780936:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984944512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597198.781056:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597198.781362:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944512 00000100:00100000:1.0:1789597198.781374:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944512 00000100:00100000:1.0:1789597198.781438:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789597198.781449:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984944512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789597198.781507:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789597198.781570:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984944512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597198.781577:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789597198.781789:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984944512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789597198.781979:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789597198.781991:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984944640:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789597198.782035:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597198.782069:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944640 00000100:00100000:0.0:1789597198.782073:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944640 00000100:00100000:0.0:1789597198.782245:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789597198.782257:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984944640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789597198.782284:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597198.782324:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984944640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597198.782331:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789597198.782351:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789597198.782376:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984944640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597199.295400:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789597199.295437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984944768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597199.295537:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597199.295944:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944768 00000100:00100000:2.0:1789597199.295965:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944768 00000100:00100000:2.0:1789597199.296032:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789597199.296043:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984944768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789597199.296090:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789597199.296160:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984944768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597199.296167:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789597199.297356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984944768:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789597199.565520:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789597199.945625:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789597200.318112:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984945280:0@lo:400:kworker.0 00000100:00100000:2.0:1789597200.318219:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597200.318292:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984945792:0@lo:400:kworker.0 00000100:00100000:2.0:1789597200.318314:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597200.318329:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984946304:0@lo:400:kworker.0 00000100:00100000:2.0:1789597200.318352:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597200.318382:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789597200.318388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984945152:0@lo:400:kworker.0 00000100:00100000:2.0:1789597200.318408:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597200.318423:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984945664:0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.318533:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984944896:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.318538:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984945024:0@lo:400:kworker.0 00000100:00100000:0.0:1789597200.318720:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945280 00000100:00100000:0.0:1789597200.318730:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945280 00000100:00100000:0.0:1789597200.318791:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945792 00000100:00100000:0.0:1789597200.318794:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945792 00000100:00100000:0.0:1789597200.318810:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945152 00000100:00100000:0.0:1789597200.318938:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945152 00000100:00100000:0.0:1789597200.318968:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789597200.318977:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984945280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.325887:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597200.325984:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597200.326073:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984945536:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.326111:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597200.326137:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984946048:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.326163:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597200.326211:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984946560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597200.326238:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597200.326274:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984945408:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.326285:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945024 00000100:00100000:1.0:1789597200.326296:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945024 00000100:00100000:3.0:1789597200.326300:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597200.326319:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984945920:0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.326339:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597200.326350:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945536 00000100:00100000:1.0:1789597200.326353:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945536 00000100:00100000:3.0:1789597200.326354:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984946432:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.326371:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789597200.326379:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984945024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.326401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597200.326444:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984945024:12345-0@lo:400:kworker.0 Request processed in 65us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.326465:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789597200.326485:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789597200.326491:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984945536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.326495:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946304 00000100:00100000:3.0:1789597200.326499:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946304 00000100:00100000:1.0:1789597200.326520:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984945536:12345-0@lo:400:kworker.0 Request processed in 29us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.326526:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789597200.326528:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946048 00000100:00100000:3.0:1789597200.326531:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946048 00000100:00100000:3.0:1789597200.326544:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945408 00000100:00100000:1.0:1789597200.326545:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945920 00000100:00100000:1.0:1789597200.326548:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945920 00000100:00100000:3.0:1789597200.326552:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945408 00000100:00100000:1.0:1789597200.326560:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946432 00000100:00100000:1.0:1789597200.326562:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946432 00000100:00100000:3.0:1789597200.326567:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789597200.326572:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984946304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.326582:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789597200.326587:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984946048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.326606:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876527984946304:12345-0@lo:400:kworker.0 Request processed in 34us (8253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.326611:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984946048:12345-0@lo:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597200.326612:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789597200.326616:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789597200.326624:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789597200.326629:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984945920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.326661:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876527984945920:12345-0@lo:400:kworker.0 Request processed in 33us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597200.326704:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597200.326745:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984944896 00000100:00100000:2.0:1789597200.326750:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984944896 00000100:00100000:2.0:1789597200.326786:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789597200.326793:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:3644:x1876527984944896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597200.326839:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+24:3644:x1876527984944896:12345-0@lo:400:kworker.0 Request processed in 47us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597200.326846:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789597200.326979:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789597200.326988:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb4589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984945408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.327019:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb4589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876527984945408:12345-0@lo:400:kworker.0 Request processed in 34us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.327025:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789597200.327037:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789597200.327043:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984946432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.327068:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876527984946432:12345-0@lo:400:kworker.0 Request processed in 25us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.327074:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789597200.327092:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946560 00000100:00100000:1.0:1789597200.327095:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946560 00000100:00100000:1.0:1789597200.327124:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789597200.327130:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984946560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789597200.327158:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789597200.327202:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876527984946560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.327208:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789597200.327262:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984946560:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597200.327276:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984945024:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.327297:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984945536:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.327309:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984946048:0@lo:400:kworker.0 00000100:00080000:1.0:1789597200.327375:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789597200.327381:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789597200.327385:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789597200.327388:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789597200.327401:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984945664 00000100:00100000:1.0:1789597200.327405:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984945664 00000100:00100000:1.0:1789597200.327431:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789597200.327618:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789597200.327653:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984946688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789597200.327707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597200.327751:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946688 00000100:00100000:3.0:1789597200.327755:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946688 00000100:00100000:3.0:1789597200.327775:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789597200.327780:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984946688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789597200.327797:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789597200.327843:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876527984946688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597200.327850:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789597200.327879:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984946688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789597200.327981:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984944896:0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.327997:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83ded180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876527984945408:0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.328008:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876527984945920:0@lo:400:kworker.0 00010000:00080000:3.0:1789597200.328036:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb7f6f800 x1876527984946432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597200.328047:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876527984946432:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.328066:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984945792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.328106:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984945792:12345-0@lo:400:kworker.0 Request processed in 669us (9791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.328114:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789597200.328131:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597200.328138:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984945152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.328179:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984945152:12345-0@lo:400:kworker.0 Request processed in 43us (9769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.328186:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789597200.328198:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789597200.328203:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e848be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984945664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.328232:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e848be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984945664:12345-0@lo:400:kworker.0 Request processed in 29us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.328237:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789597200.328255:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789597200.328265:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984945664:0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.328273:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984946176:0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.328300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597200.328325:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83defb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984945792:0@lo:400:kworker.0 00000100:00100000:3.0:1789597200.328338:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83def100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876527984946304:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.328338:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946176 00000100:00100000:1.0:1789597200.328342:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946176 00000100:00100000:3.0:1789597200.328359:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984945152:0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.328382:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789597200.328389:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984946176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597200.328434:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876527984946176:12345-0@lo:400:kworker.0 Request processed in 46us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597200.328544:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789597200.328562:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789597200.331139:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d83dece00 x1876527984946176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597200.331164:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876527984946176:0@lo:400:kworker.0 00000100:00100000:0.0:1789597200.331836:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984945280:12345-0@lo:400:kworker.0 Request processed in 12853us (13609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597200.331852:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789597200.332589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984945280:0@lo:400:kworker.0 00010000:00010000:1.0:1789597200.573048:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789597201.327295:0:25497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1789597201.365367:0:22593:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be7b4031-1e67-4349-a0a6-83f95986ed0a 00000001:00100000:2.0:1789597201.365387:0:22593:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7df745ac-3f71-492a-842b-2e7c88612cac 00000001:00100000:1.0:1789597201.369333:0:23347:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of be7b4031-1e67-4349-a0a6-83f95986ed0a 00000001:00100000:1.0:1789597201.369353:0:23347:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7df745ac-3f71-492a-842b-2e7c88612cac 00000001:00100000:1.0:1789597201.371581:0:24117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be7b4031-1e67-4349-a0a6-83f95986ed0a 00000001:00100000:1.0:1789597201.371601:0:24117:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7df745ac-3f71-492a-842b-2e7c88612cac 00010000:00010000:0.0:1789597201.596918:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597201.854831:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984946816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789597201.854927:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597201.855039:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946816 00000100:00100000:0.0:1789597201.855050:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946816 00000100:00100000:0.0:1789597201.855123:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789597201.855133:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984946816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789597201.855180:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789597201.858562:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984946816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3412us (3617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597201.858581:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789597201.859994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984946816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789597202.622085:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789597203.069626:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789597203.455899:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597203.455951:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597203.455988:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597203.455997:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760000 00000100:00100000:1.0:1789597203.456011:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760000 00000100:00100000:0.0:1789597203.456021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597203.456037:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597203.456060:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597203.456076:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:0.0:1789597203.456079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597203.456089:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:2409:x1876527961760000:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597203.456095:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597203.456118:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597203.456189:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760512 00000100:00100000:2.0:1789597203.456195:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760512 00000100:00100000:3.0:1789597203.456199:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760256 00000100:00100000:3.0:1789597203.456202:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760256 00000100:00100000:2.0:1789597203.456237:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961761024 00000100:00100000:2.0:1789597203.456240:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961761024 00000100:00100000:1.0:1789597203.456263:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:2409:x1876527961760000:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 175us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597203.456274:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:1.0:1789597203.456318:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760384 00000100:00100000:1.0:1789597203.456322:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760384 00000100:00100000:3.0:1789597203.457791:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760768 00000100:00100000:3.0:1789597203.457807:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760768 00000100:00100000:3.0:1789597203.457836:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760128 00000100:00100000:3.0:1789597203.457839:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760128 00000100:00100000:3.0:1789597203.457875:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760640 00000100:00100000:3.0:1789597203.457879:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760640 00000100:00100000:3.0:1789597203.457903:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:3.0:1789597203.457915:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+5:2409:x1876527961760256:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597203.464864:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961760896 00000100:00100000:2.0:1789597203.464886:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961760896 00000100:00100000:2.0:1789597203.464930:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:2.0:1789597203.464945:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+5:2409:x1876527961760512:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597203.465370:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789597203.465380:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2409:x1876527961761024:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597203.465450:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2409:x1876527961761024:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 70us (9410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597203.465458:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:0.0:1789597203.465482:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789597203.465490:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2409:x1876527961760896:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597203.465515:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2409:x1876527961760896:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (9396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597203.465521:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:0.0:1789597203.465585:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:0.0:1789597203.465595:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2409:x1876527961760768:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597203.465647:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2409:x1876527961760768:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 54us (9624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597203.465655:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:0.0:1789597203.465672:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789597203.465705:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+6:2409:x1876527961760128:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597203.465734:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+6:2409:x1876527961760128:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 55us (9673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597203.465738:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:0.0:1789597203.465749:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:0.0:1789597203.465754:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2409:x1876527961760640:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1789597203.465775:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83697480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2409:x1876527961760640:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (9679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597203.465797:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00080000:0.0:1789597203.465827:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789597203.465833:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789597203.465835:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789597203.465838:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789597203.468632:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789597203.468655:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7df745ac-3f71-492a-842b-2e7c88612cac+5:2409:x1876527961760384:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1789597203.468788:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83694e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7df745ac-3f71-492a-842b-2e7c88612cac+5:2409:x1876527961760384:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 142us (12707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597203.468816:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:3.0:1789597203.472433:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+5:2409:x1876527961760256:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 14493us (16453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597203.472453:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:2.0:1789597203.478744:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83696d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+5:2409:x1876527961760512:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 13779us (22731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597203.478768:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00010000:00010000:3.0:1789597203.668599:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597203.903647:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984946944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597203.903780:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597203.903859:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984946944 00000100:00100000:2.0:1789597203.903870:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984946944 00000100:00100000:2.0:1789597203.903943:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789597203.903953:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984946944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597203.903999:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789597203.904051:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984946944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597203.904080:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789597203.904145:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984946944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789597203.908771:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984947072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789597203.908865:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597203.913874:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984947072 00000100:00100000:2.0:1789597203.913900:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984947072 00000100:00100000:2.0:1789597203.914024:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789597203.914038:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984947072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789597203.914088:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789597203.914211:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984947072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 177us (5346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597203.914219:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789597203.914246:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597203.914304:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984947072:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1789597203.919340:0:24940:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be7b4031-1e67-4349-a0a6-83f95986ed0a 00000100:00100000:1.0:1789597204.414090:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984947200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597204.414203:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597204.414302:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984947200 00000100:00100000:1.0:1789597204.414311:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984947200 00000100:00100000:1.0:1789597204.414370:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789597204.414382:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984947200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789597204.414430:0:22618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789597204.414482:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984947200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597204.414489:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789597204.414547:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984947200:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789597204.669125:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789597205.102910:0:25645:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1ec702a0 20000000:00000080:1.0:1789597205.102937:0:25645:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7ebe1c9c00 uarg=0000000000000000 20000000:01000000:1.0:1789597205.102993:0:25645:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789597205.103001:0:25645:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789597205.103007:0:25645:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789597205.103590:0:25646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1789597205.104589:0:25645:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789597205.110068:0:25645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789597205.110133:0:25645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110160:0:25645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110169:0:25645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc04da expref: 23 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110197:0:25645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110205:0:25645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc069a expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110218:0:25645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 12 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110227:0:25645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110235:0:25645:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110310:0:25645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110336:0:25645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 12 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.110356:0:25645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947328:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597205.110553:0:25645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 12 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110562:0:25645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 12 pid: 22608 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.110571:0:25645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947456:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597205.110616:0:25645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc069a expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110625:0:25645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc069a expref: 23 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.110634:0:25645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947584:0@lo:104: 00000100:00100000:1.0:1789597205.110844:0:25645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789597205.110888:0:25645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110897:0:25645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 23 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.110905:0:25645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869bea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947712:0@lo:104: 00000100:00100000:1.0:1789597205.110925:0:25645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789597205.110942:0:25645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc04da expref: 23 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110950:0:25645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc04da expref: 23 pid: 22606 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.110958:0:25645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947840:0@lo:104: 00000100:00100000:1.0:1789597205.110974:0:25645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789597205.110986:0:25645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.110993:0:25645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 23 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.111012:0:25645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947968:0@lo:104: 00000100:00100000:1.0:1789597205.111030:0:25645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597205.111040:0:25645:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789597205.111109:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984947584 00000100:00100000:2.0:1789597205.111118:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984947584 00000100:00100000:2.0:1789597205.111177:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984947712 00000100:00100000:2.0:1789597205.111180:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984947712 00000100:00100000:2.0:1789597205.111191:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984947840 00000100:00100000:2.0:1789597205.111193:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984947840 00000100:00100000:2.0:1789597205.111202:0:22597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984947968 00000100:00100000:2.0:1789597205.111204:0:22597:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984947968 00000100:00100000:2.0:1789597205.111218:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597205.111228:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+6:25645:x1876527984947584:12345-0@lo:104: 00010000:00010000:2.0:1789597205.111253:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111336:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789597205.111343:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+6:25645:x1876527984947584:12345-0@lo:104: Request processed in 117us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.111351:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597205.111370:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789597205.111376:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+5:25645:x1876527984947712:12345-0@lo:104: 00010000:00010000:2.0:1789597205.111384:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111415:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789597205.111420:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+5:25645:x1876527984947712:12345-0@lo:104: Request processed in 45us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.111426:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789597205.111438:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789597205.111443:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:25645:x1876527984947840:12345-0@lo:104: 00010000:00010000:2.0:1789597205.111450:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111485:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789597205.111490:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+4:25645:x1876527984947840:12345-0@lo:104: Request processed in 48us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.111496:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789597205.111507:0:22597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789597205.111513:0:22597:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:25645:x1876527984947968:12345-0@lo:104: 00010000:00010000:2.0:1789597205.111526:0:22597:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111565:0:22597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789597205.111570:0:22597:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:980ee822-f655-4df0-a283-f316bd6c264b+3:25645:x1876527984947968:12345-0@lo:104: Request processed in 58us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.111576:0:22597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789597205.111599:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789597205.111607:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111614:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dac00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597205.111619:0:24577:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111629:0:24577:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597205.111637:0:24577:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597205.111644:0:24577:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789597205.111707:0:24577:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111715:0:24577:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597205.111741:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111749:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7eb98dac00/0x7b5398e289bc069a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc06a1 expref: -99 pid: 24939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111771:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789597205.111774:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111779:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833ddc00 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597205.111782:0:24577:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111789:0:24577:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597205.111796:0:24577:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597205.111801:0:24577:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789597205.111816:0:24577:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111822:0:24577:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597205.111837:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111844:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7d833ddc00/0x7b5398e289bc0519 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc0520 expref: -99 pid: 24116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111852:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789597205.111855:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111871:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80031800 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597205.111874:0:24577:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111881:0:24577:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597205.111888:0:24577:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597205.111893:0:24577:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789597205.111907:0:24577:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111913:0:24577:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597205.111919:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111926:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80031800/0x7b5398e289bc04da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04e1 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111935:0:24577:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597205.111938:0:24577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111944:0:24577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e80030600 already unused, calling callback (ffffffffc1431c20) 10000000:00010000:2.0:1789597205.111947:0:24577:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111963:0:24577:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789597205.111970:0:24577:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597205.111975:0:24577:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789597205.111986:0:24577:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.111992:0:24577:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789597205.111998:0:24577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112005:0:24577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.116@tcp lock: ffff9c7e80030600/0x7b5398e289bc04cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7b5398e289bc04d3 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112020:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597205.112022:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597205.112024:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597205.112030:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597205.112037:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597205.112042:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789597205.112066:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984948096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597205.112103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.112142:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789597205.112148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984948480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597205.112170:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.112208:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984948224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597205.112231:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.112248:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789597205.112253:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984948352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597205.112273:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.112297:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948096 00000100:00100000:2.0:1789597205.112303:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948096 00010000:00010000:2.0:1789597205.112328:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc069a expref: 24 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.112345:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948480 00000100:00100000:2.0:1789597205.112347:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948480 00010000:00010000:2.0:1789597205.112356:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 25 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.112364:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948224 00000100:00100000:2.0:1789597205.112366:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948224 00010000:00010000:2.0:1789597205.112397:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 26 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.112409:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948352 00000100:00100000:2.0:1789597205.112412:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948352 00010000:00010000:2.0:1789597205.112421:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04da expref: 27 pid: 22606 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.112434:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597205.112441:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+27:3647:x1876527984948096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597205.112455:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597205.112462:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc069a expref: 27 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112484:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc069a expref: 27 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112503:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597205.112535:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+27:3647:x1876527984948096:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.112542:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789597205.112559:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789597205.112565:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+26:3647:x1876527984948480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597205.112573:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597205.112577:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 26 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112584:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 26 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112593:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597205.112611:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+26:3647:x1876527984948480:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.112617:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789597205.112628:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789597205.112632:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+25:3644:x1876527984948224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597205.112639:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597205.112643:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 25 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112649:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 25 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112665:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597205.112713:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+25:3644:x1876527984948224:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.112720:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789597205.112733:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789597205.112738:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+24:3644:x1876527984948352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789597205.112747:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597205.112752:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7b5398e289bc04da expref: 24 pid: 22606 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112760:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7b5398e289bc04da expref: 24 pid: 22606 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.112770:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597205.112788:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:980ee822-f655-4df0-a283-f316bd6c264b+24:3644:x1876527984948352:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.112794:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789597205.112839:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984948352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597205.112847:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:980ee822-f655-4df0-a283-f316bd6c264b:3644:1876527984948224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597205.112871:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984948480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789597205.112878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984948096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789597205.113101:0:25645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7d833dda00/0x7b5398e289bc06a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc069a expref: 23 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.113114:0:25645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947584:0@lo:104: 00010000:00010000:1.0:1789597205.113135:0:25645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80030a00/0x7b5398e289bc0520 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc0519 expref: 22 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.113144:0:25645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947712:0@lo:104: 00010000:00010000:1.0:1789597205.113153:0:25645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e80031e00/0x7b5398e289bc04e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc04da expref: 21 pid: 22606 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.113161:0:25645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947840:0@lo:104: 00010000:00010000:1.0:1789597205.113169:0:25645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc04d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7b5398e289bc04cc expref: 20 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597205.113176:0:25645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947968:0@lo:104: 00000100:00100000:3.0:1789597205.117798:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597205.117838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597205.117974:0:25645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869bd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947328:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789597205.117989:0:25645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e869be680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25645:1876527984947456:192.168.202.16@tcp:104: 00010000:00010000:1.0:1789597205.118040:0:25645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.118201:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961761152 00000100:00100000:2.0:1789597205.118211:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961761152 00010000:00010000:2.0:1789597205.118251:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 13 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.118304:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961761280 00000100:00100000:2.0:1789597205.118307:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961761280 00010000:00010000:2.0:1789597205.118316:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 14 pid: 22608 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.118326:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1789597205.118333:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83178c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92535339-8580-4a0b-a747-d4b79f5081f6+14:2408:x1876527961761152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597205.118355:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597205.118360:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 14 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118372:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 14 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118395:0:22598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7eb98db200/0x7b5398e289bc0845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f0a expref: 14 pid: 22607 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118415:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597205.118489:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83178c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92535339-8580-4a0b-a747-d4b79f5081f6+13:2408:x1876527961761152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 153us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.118497:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 13 00000100:00100000:2.0:1789597205.118559:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 14 00000100:00100000:2.0:1789597205.118566:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92535339-8580-4a0b-a747-d4b79f5081f6+12:2409:x1876527961761280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597205.118574:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597205.118580:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 12 pid: 22608 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118601:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 12 pid: 22608 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118612:0:22598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7ead4e4000/0x7b5398e289bc0806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07e9a expref: 12 pid: 22608 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118627:0:22598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118636:0:22598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118652:0:22598:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118661:0:22598:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118668:0:22598:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118674:0:22598:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118697:0:22598:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597205.118701:0:22598:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118709:0:22598:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118727:0:22598:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597205.118735:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597205.118751:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92535339-8580-4a0b-a747-d4b79f5081f6+11:2409:x1876527961761280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 187us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.118756:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 14 00010000:00010000:1.0:1789597205.119233:0:25645:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.119252:0:25645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597205.119256:0:25645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7e869a1c00/0x7b5398e289bc0876 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597205.437243:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984948864:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.437343:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.437393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984949376:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.437415:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.437433:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984949888:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.437492:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.437525:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789597205.437532:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984948736:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.437558:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.437578:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984949248:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.437598:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597205.437616:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984949760:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.437636:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597205.437761:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984948608:0@lo:400:kworker.0 00000100:00100000:0.0:1789597205.437805:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597205.437836:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984949120:0@lo:400:kworker.0 00000100:00100000:3.0:1789597205.437976:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948608 00000100:00100000:3.0:1789597205.437987:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948608 00000100:00100000:3.0:1789597205.438049:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789597205.438060:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:3647:x1876527984948608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597205.438142:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+20:3647:x1876527984948608:12345-0@lo:400:kworker.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597205.438151:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789597205.438226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984950272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789597205.438254:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597205.438288:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984950272 00000100:00100000:3.0:1789597205.438292:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984950272 00000100:00100000:3.0:1789597205.438331:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789597205.438338:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984950272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789597205.438365:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789597205.438403:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984950272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597205.438409:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789597205.438439:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789597205.438483:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984950272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789597205.438621:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984948992:0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.438666:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597205.438707:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984949504:0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.438730:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597205.444617:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948736 00000100:00100000:3.0:1789597205.444643:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948736 00000100:00100000:3.0:1789597205.444749:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984949248 00000100:00100000:3.0:1789597205.444754:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984949248 00000100:00100000:3.0:1789597205.444778:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789597205.444790:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984948736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597205.444942:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984948736:12345-0@lo:400:kworker.0 Request processed in 153us (7381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597205.444951:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789597205.444973:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789597205.444979:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984949248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789597205.445013:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984949248:12345-0@lo:400:kworker.0 Request processed in 34us (7414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597205.445020:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789597205.448414:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984950016:0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.448542:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948864 00000100:00100000:1.0:1789597205.448554:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948864 00000100:00100000:1.0:1789597205.448639:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984949376 00000100:00100000:1.0:1789597205.448644:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984949376 00000100:00100000:1.0:1789597205.448660:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984948992 00000100:00100000:1.0:1789597205.448663:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984948992 00000100:00100000:1.0:1789597205.448693:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984949504 00000100:00100000:1.0:1789597205.448697:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984949504 00000100:00100000:1.0:1789597205.448720:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789597205.448731:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984948864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.448810:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984948864:12345-0@lo:400:kworker.0 Request processed in 81us (11466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597205.448818:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789597205.448839:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789597205.448845:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984949376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.448900:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984949376:12345-0@lo:400:kworker.0 Request processed in 55us (11484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597205.448906:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789597205.448920:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597205.448925:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984948992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.448959:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984948992:12345-0@lo:400:kworker.0 Request processed in 34us (10292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597205.448964:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597205.448974:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789597205.448981:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984949504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.449007:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984949504:12345-0@lo:400:kworker.0 Request processed in 28us (10277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597205.449012:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789597205.449083:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789597205.449089:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597205.449098:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597205.449112:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984950400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597205.449156:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597205.449191:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984950400 00000100:00100000:1.0:1789597205.449195:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984950400 00000100:00100000:1.0:1789597205.449221:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597205.449228:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984950400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789597205.449246:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789597205.449284:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83def100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984950400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597205.449290:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789597205.449349:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984950400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789597205.453447:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984948864:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.453472:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984949376:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.453509:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984948736:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.453555:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984949248:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.453599:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597205.453773:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984949888 00000100:00100000:0.0:1789597205.453784:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984949888 00000100:00100000:0.0:1789597205.453878:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984949760 00000100:00100000:0.0:1789597205.453883:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984949760 00000100:00100000:0.0:1789597205.453923:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789597205.453934:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984949888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597205.454034:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984949888:12345-0@lo:400:kworker.0 Request processed in 103us (16542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597205.454042:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789597205.454061:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789597205.454067:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984949760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597205.454095:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984949760:12345-0@lo:400:kworker.0 Request processed in 28us (16458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597205.454100:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789597205.454242:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984949760:0@lo:400:kworker.0 00010000:00080000:3.0:1789597205.454261:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb7f6dc00 x1876527984949888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789597205.454272:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984949888:0@lo:400:kworker.0 00000100:00080000:1.0:1789597205.454350:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789597205.454356:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597205.455401:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984948992:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.455420:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984949504:0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.455524:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597205.460567:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984949632:0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.460666:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597205.460753:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984950016 00000100:00100000:0.0:1789597205.460765:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984950016 00000100:00080000:3.0:1789597205.460882:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597205.464555:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984949120 00000100:00100000:2.0:1789597205.464581:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984949120 00000100:00100000:2.0:1789597205.464702:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789597205.464717:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984950016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.464869:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984950016:12345-0@lo:400:kworker.0 Request processed in 155us (11268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.464877:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789597205.464951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984950016:0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.464991:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789597205.464998:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984949120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597205.465030:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876527984949120:12345-0@lo:400:kworker.0 Request processed in 34us (9507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597205.465036:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789597205.465335:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984950144:0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.465382:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597205.465427:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:980ee822-f655-4df0-a283-f316bd6c264b:3647:1876527984948608:0@lo:400:kworker.0 00000100:00100000:1.0:1789597205.465441:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876527984949120:0@lo:400:kworker.0 00000100:00100000:0.0:1789597205.465554:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984949632 00000100:00100000:0.0:1789597205.465562:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984949632 00000100:00100000:0.0:1789597205.465588:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984950144 00000100:00100000:0.0:1789597205.465607:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984950144 00000100:00100000:0.0:1789597205.465642:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789597205.465649:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984949632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597205.465712:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876527984949632:12345-0@lo:400:kworker.0 Request processed in 64us (5046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597205.465719:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789597205.465731:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789597205.465736:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984950144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789597205.465763:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876527984950144:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597205.465770:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789597205.465787:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789597205.465921:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876527984949632:0@lo:400:kworker.0 00010000:00080000:0.0:1789597205.465935:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb7f6d880 x1876527984950144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789597205.465946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876527984950144:0@lo:400:kworker.0 00010000:00010000:2.0:1789597205.693333:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597206.150478:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597206.150636:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961761408 00000100:00100000:2.0:1789597206.150650:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961761408 00000100:00100000:2.0:1789597206.150827:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:2.0:1789597206.150840:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+6:18671:x1876527961761408:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789597206.150878:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597206.150909:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc087d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f42 expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151015:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151033:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151049:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151067:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151074:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151081:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151213:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bc0892 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151223:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bc0892 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151230:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bc0892 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597206.151264:0:25157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789597206.151268:0:25157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597206.151313:0:25157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bc0892 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151335:0:25157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151342:0:25157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151348:0:25157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151355:0:25157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dcc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.151361:0:25157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151369:0:25157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151383:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:2.0:1789597206.151386:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.151392:0:25157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151398:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc0884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151412:0:25157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151418:0:25157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151423:0:25157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151434:0:25157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833ddc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.151437:0:25157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151443:0:25157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151452:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c7e82a39900) 00010000:00010000:2.0:1789597206.151454:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.151457:0:25157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151463:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc088b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151503:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc087d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f42 expref: 8 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151518:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dda00/0x7b5398e289bc0892 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f42 expref: 7 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.151526:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7e82a39500) 00010000:00010000:2.0:1789597206.151529:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789597206.151531:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dda00, rc 0) 00000100:00100000:2.0:1789597206.151618:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+7:18671:x1876527961761408:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 780us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597206.151625:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 23 00000100:00100000:3.0:1789597206.154145:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.154254:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961761536 00000100:00100000:1.0:1789597206.154268:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961761536 00000100:00100000:1.0:1789597206.154338:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:1.0:1789597206.154350:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7df745ac-3f71-492a-842b-2e7c88612cac+7:18671:x1876527961761536:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789597206.154464:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7df745ac-3f71-492a-842b-2e7c88612cac+7:18671:x1876527961761536:12345-192.168.202.16@tcp:900:lhsmtool_posix.0 Request processed in 116us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.154473:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00080000:0.0:1789597206.160289:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789597206.162376:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597206.162589:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961761792 00000100:00100000:2.0:1789597206.162633:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961761792 00000100:00100000:2.0:1789597206.162741:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1789597206.162753:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+7:18671:x1876527961761792:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789597206.162783:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597206.162809:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc0899 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f49 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163175:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163195:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163210:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163228:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163235:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163242:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163398:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bc08ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163407:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bc08ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.163415:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bc08ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597206.163438:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789597206.163834:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164018:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164029:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164036:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833ddc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.164042:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164051:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164069:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7e82a39500) 00010000:00010000:2.0:1789597206.164142:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.164150:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164158:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164176:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164182:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164201:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164207:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dcc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.164210:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164216:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164225:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7e82a39900) 00010000:00010000:2.0:1789597206.164228:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.164231:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.164236:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc08a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.166981:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc0899 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f49 expref: 10 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.167026:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc600/0x7b5398e289bc08ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f49 expref: 9 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.167037:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39800) 00010000:00010000:2.0:1789597206.167041:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.167044:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc600, rc 0) 00000100:00100000:2.0:1789597206.167326:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+9:18671:x1876527961761792:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 4572us (4961us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789597206.167356:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:2.0:1789597206.178739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.179320:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961761920 00000100:00100000:0.0:1789597206.179335:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961761920 00000100:00100000:0.0:1789597206.179418:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:0.0:1789597206.179432:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+9:18671:x1876527961761920:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789597206.179595:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+9:18671:x1876527961761920:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 166us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.179604:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:3.0:1789597206.181168:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.181725:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961762048 00000100:00100000:0.0:1789597206.181737:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961762048 00000100:00100000:0.0:1789597206.181827:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:0.0:1789597206.181838:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+5:18671:x1876527961762048:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789597206.182380:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789597206.183235:0:22615:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1326us 00000100:00100000:2.0:1789597206.206910:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.207040:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961762176 00000100:00100000:3.0:1789597206.207056:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961762176 00000100:00100000:3.0:1789597206.207145:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:3.0:1789597206.207159:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+9:18677:x1876527961762176:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789597206.207190:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597206.207221:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f50 expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.207304:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.207324:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.207343:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.208984:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209010:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209025:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209318:0:25157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209327:0:25157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209366:0:25157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209372:0:25157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597206.209377:0:25157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209385:0:25157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209400:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:3.0:1789597206.209404:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597206.209409:0:25157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209414:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209434:0:25157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209439:0:25157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209446:0:25157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209453:0:25157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597206.209456:0:25157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209755:0:25157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209764:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7d8370b900) 00010000:00010000:3.0:1789597206.209767:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597206.209771:0:25157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209777:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209837:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f50 expref: 10 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209852:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:3.0:1789597206.209856:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597206.209860:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f50 expref: 10 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.209873:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da400, rc 0) 00000100:00100000:3.0:1789597206.210655:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+9:18677:x1876527961762176:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 3491us (3756us total) trans 0 rc 301/301 00000100:00100000:3.0:1789597206.210668:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 27 00000100:00100000:2.0:1789597206.216813:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.225407:0:22622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961762304 00000100:00100000:1.0:1789597206.225437:0:22622:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961762304 00000100:00100000:1.0:1789597206.225523:0:22622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789597206.225536:0:22623:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:1.0:1789597206.225539:0:22622:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7df745ac-3f71-492a-842b-2e7c88612cac+9:18677:x1876527961762304:12345-192.168.202.16@tcp:700:lfs.0 00000100:00100000:0.0:1789597206.225550:0:22623:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:1.0:1789597206.225703:0:22622:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7df745ac-3f71-492a-842b-2e7c88612cac+9:18677:x1876527961762304:12345-192.168.202.16@tcp:700:lfs.0 Request processed in 166us (8903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.225712:0:22622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789597206.231260:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.231384:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961762560 00000100:00100000:0.0:1789597206.231398:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961762560 00000100:00100000:0.0:1789597206.231477:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:0.0:1789597206.231490:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+9:18677:x1876527961762560:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:0.0:1789597206.231570:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789597206.231606:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0c00/0x7b5398e289bc0830 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ecb expref: 9 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.231636:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:0.0:1789597206.231643:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789597206.231759:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.231776:0:22613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 5 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.231787:0:22613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.231831:0:22613:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 5 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.232419:0:22613:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 5 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597206.232469:0:22613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83695f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22613:1876527984950528:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789597206.232984:0:22613:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789597206.235900:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+5:18671:x1876527961762048:12345-192.168.202.16@tcp:59:lhsmtool_posix.0 Request processed in 54048us (54729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597206.235918:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789597206.247746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.248105:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961762688 00000100:00100000:3.0:1789597206.248130:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961762688 00010000:00010000:3.0:1789597206.248215:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 6 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597206.248269:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00100000:3.0:1789597206.248283:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2409:x1876527961762688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597206.248303:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597206.248311:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 6 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.248329:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 6 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.248361:0:22598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:3.0:1789597206.248369:0:22598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.248381:0:22598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.248391:0:22598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.248418:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597206.248505:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2409:x1876527961762688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 225us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597206.248514:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 15 00000100:00080000:0.0:1789597206.248882:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789597206.250240:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc086f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f3b expref: 5 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597206.250271:0:22613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83695f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22613:1876527984950528:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789597206.250310:0:22613:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.250323:0:22613:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.250330:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.250369:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.250384:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.250396:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258107:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258170:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258188:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789597206.258214:0:22613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed9b006f reply state 0000000069c1ba9e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258228:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258237:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:3.0:1789597206.258240:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789597206.258246:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789597206.258254:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789597206.258266:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258275:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258283:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258290:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e4200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597206.258296:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258305:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258329:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7eb9a8f800) 00010000:00010000:3.0:1789597206.258332:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597206.258337:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258344:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc08d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789597206.258380:0:22613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed9b006f reply state 0000000069c1ba9e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258389:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.258397:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7e82a39900) 00010000:00010000:3.0:1789597206.258399:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789597206.258401:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789597206.258600:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+10:18677:x1876527961762560:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 27106us (27350us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789597206.258610:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789597206.348130:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.348279:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961762816 00000100:00100000:3.0:1789597206.348292:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961762816 00000100:00100000:3.0:1789597206.348370:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789597206.348383:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+10:18685:x1876527961762816:12345-192.168.202.16@tcp:101:lctl.0 00010000:00010000:3.0:1789597206.348417:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597206.348448:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f57 expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.348545:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.348581:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.348596:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789597206.348663:0:25157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789597206.348668:0:25157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789597206.348756:0:25157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.348786:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc08e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f57 expref: 12 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.348809:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da400/0x7b5398e289bc08ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f57 expref: 11 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.348818:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:3.0:1789597206.348821:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789597206.348826:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da400, rc 0) 00000100:00100000:3.0:1789597206.348920:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+11:18685:x1876527961762816:12345-192.168.202.16@tcp:101:lctl.0 Request processed in 539us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597206.348927:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:3.0:1789597206.386927:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.387193:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961762944 00000100:00100000:0.0:1789597206.387208:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961762944 00000100:00100000:0.0:1789597206.387444:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789597206.387458:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:18686:x1876527961762944:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789597206.387491:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597206.387526:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc08f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f5e expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.387624:0:22615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc08fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.387869:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc08fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.387950:0:22615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc08fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597206.388020:0:22615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789597206.388025:0:22615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789597206.388057:0:22615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc08fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.388167:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4a00/0x7b5398e289bc08f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f5e expref: 7 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.388205:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5a00/0x7b5398e289bc08fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f5e expref: 6 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.388235:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:0.0:1789597206.388238:0:22615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789597206.388243:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e5a00, rc 0) 00000100:00100000:0.0:1789597206.388508:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18686:x1876527961762944:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1051us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.388517:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789597206.393175:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.393536:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961763072 00000100:00100000:3.0:1789597206.393549:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961763072 00000100:00100000:3.0:1789597206.393672:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 31 00000100:00100000:3.0:1789597206.393717:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:18686:x1876527961763072:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789597206.393763:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597206.393790:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc0902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f65 expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.393875:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394008:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394024:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394037:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394045:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394051:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394239:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0917 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394249:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0917 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.394467:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0917 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597206.394979:0:25157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789597206.394987:0:25157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597206.395017:0:25157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0917 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395054:0:25157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395062:0:25157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395070:0:25157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395153:0:25157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dac00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.395159:0:25157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395169:0:25157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395186:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:2.0:1789597206.395189:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.395194:0:25157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395201:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dac00/0x7b5398e289bc0909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395216:0:25157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395222:0:25157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395227:0:25157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395240:0:25157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98dae00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.395244:0:25157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395310:0:25157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395321:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7e82a39900) 00010000:00010000:2.0:1789597206.395323:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.395326:0:25157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395333:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98dae00/0x7b5398e289bc0910 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395371:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db800/0x7b5398e289bc0902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f65 expref: 8 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395388:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0917 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f65 expref: 7 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.395396:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:2.0:1789597206.395399:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789597206.395401:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98da200, rc 0) 00000100:00100000:2.0:1789597206.395541:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+7:18686:x1876527961763072:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1826us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597206.395551:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 31 10000000:01000000:1.0:1789597206.399209:0:22610:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789597206.399220:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d83406800 from 13 10000000:01000000:1.0:1789597206.399227:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789597206.399296:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bc091e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.399310:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bc091e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.399323:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bc091e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597206.399359:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984950656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789597206.399440:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597206.399501:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789597206.399590:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984950656 00000100:00100000:0.0:1789597206.399601:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984950656 00000100:00100000:0.0:1789597206.399713:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789597206.399724:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+20:22610:x1876527984950656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597206.399741:0:22606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597206.399759:0:22606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc0925 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc091e expref: -99 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.399791:0:22606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc0925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc091e expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.399806:0:22606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7ead4e4a00/0x7b5398e289bc0925 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc091e expref: 21 pid: 22606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.399817:0:22606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4a00, rc 0) 00000100:00100000:0.0:1789597206.399866:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984950656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.399874:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789597206.399987:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984950656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597206.400006:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bc091e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0925 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.400017:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bc091e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0925 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597206.400126:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984950784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789597206.400156:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597206.400191:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789597206.400311:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984950784 00000100:00100000:0.0:1789597206.400334:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984950784 00000100:00100000:0.0:1789597206.400366:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789597206.400374:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984950784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.400525:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984950784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.400533:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789597206.401106:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984950784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789597206.401185:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984950912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789597206.401242:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597206.401276:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7eb00fc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789597206.401385:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984950912 00000100:00100000:0.0:1789597206.401391:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984950912 00000100:00100000:0.0:1789597206.401427:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789597206.401434:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984950912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.401544:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984950912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.401552:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789597206.401666:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83deed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984950912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789597206.403496:0:25660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789597206.403951:0:22610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789597206.403982:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789597206.403997:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bc091e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0925 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.404011:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7e869a0e00/0x7b5398e289bc091e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0925 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789597206.404024:0:22610:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789597206.404027:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7e9dfc1800 from 13 10000000:01000000:0.0:1789597206.404031:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789597206.404095:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5400/0x7b5398e289bc092c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.404105:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5400/0x7b5398e289bc092c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.404151:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5400/0x7b5398e289bc092c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597206.404184:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.404282:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597206.404374:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789597206.405028:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.405229:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951040 00000100:00100000:3.0:1789597206.405247:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951040 00000100:00100000:3.0:1789597206.405309:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789597206.405319:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+21:22610:x1876527984951040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597206.405339:0:22608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597206.405356:0:22608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7eb98dba00/0x7b5398e289bc0933 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc092c expref: -99 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.405385:0:22608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7eb98dba00/0x7b5398e289bc0933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc092c expref: 22 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.405395:0:22608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7eb98dba00/0x7b5398e289bc0933 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc092c expref: 22 pid: 22608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.405405:0:22608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98dba00, rc 0) 00000100:00100000:3.0:1789597206.405471:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb67e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+22:22610:x1876527984951040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597206.405478:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789597206.405581:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789597206.405600:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5400/0x7b5398e289bc092c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0933 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.405611:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5400/0x7b5398e289bc092c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0933 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597206.405733:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.405772:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597206.405795:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789597206.405912:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951168 00000100:00100000:3.0:1789597206.405918:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951168 00000100:00100000:3.0:1789597206.405951:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789597206.405958:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:22610:x1876527984951168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597206.406250:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:22610:x1876527984951168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597206.406257:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789597206.406341:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.406375:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.406425:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597206.406448:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f480 going to sleep for 11 seconds 00000100:00100000:3.0:1789597206.406499:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951296 00000100:00100000:3.0:1789597206.406504:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951296 00000100:00100000:3.0:1789597206.406534:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789597206.406541:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:22610:x1876527984951296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597206.406738:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:22610:x1876527984951296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597206.406745:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789597206.406786:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789597206.407307:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961763200 00000100:00100000:1.0:1789597206.407314:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961763200 00000100:00100000:1.0:1789597206.407379:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1789597206.407388:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:18686:x1876527961763200:12345-192.168.202.16@tcp:900:lfs.0 00000100:00100000:1.0:1789597206.407462:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:18686:x1876527961763200:12345-192.168.202.16@tcp:900:lfs.0 Request processed in 75us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.407468:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00080000:3.0:1789597206.408647:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789597206.410813:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.410934:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961763456 00000100:00100000:1.0:1789597206.410949:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961763456 00000100:00100000:1.0:1789597206.411021:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 32 00000100:00100000:1.0:1789597206.411033:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+7:18686:x1876527961763456:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789597206.411061:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597206.411099:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0a00/0x7b5398e289bc093a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f6c expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597206.411255:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789597206.411397:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0a00/0x7b5398e289bc093a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f6c expref: 9 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.411414:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:1.0:1789597206.411418:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789597206.411424:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0a00/0x7b5398e289bc093a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f6c expref: 9 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.411461:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0a00, rc 0) 00000100:00100000:1.0:1789597206.411555:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+8:18686:x1876527961763456:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 524us (757us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1789597206.411563:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 32 00000040:00080000:2.0:1789597206.415467:0:25661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789597206.417388:0:22610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789597206.417438:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789597206.417454:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5400/0x7b5398e289bc092c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0933 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.417470:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7ead4e5400/0x7b5398e289bc092c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0933 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789597206.417486:0:22610:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789597206.417490:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7eb98c4000 from 13 10000000:01000000:3.0:1789597206.417494:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789597206.417548:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da600/0x7b5398e289bc0948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.417558:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da600/0x7b5398e289bc0948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.417572:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da600/0x7b5398e289bc0948 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597206.417604:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789597206.418067:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597206.418233:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789597206.418314:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951424 00000100:00100000:2.0:1789597206.418326:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951424 00000100:00100000:2.0:1789597206.418393:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789597206.418405:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+22:22610:x1876527984951424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597206.418422:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597206.418440:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7d833dde00/0x7b5398e289bc094f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc0948 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.418471:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7d833dde00/0x7b5398e289bc094f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc0948 expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.418485:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7d833dde00/0x7b5398e289bc094f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc0948 expref: 23 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.418495:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dde00, rc 0) 00000100:00100000:2.0:1789597206.418544:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984951424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597206.418552:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789597206.420456:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789597206.420490:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da600/0x7b5398e289bc0948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc094f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.420505:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da600/0x7b5398e289bc0948 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc094f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597206.420821:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597206.422825:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789597206.423245:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951552 00000100:00100000:0.0:1789597206.423257:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951552 00000100:00100000:0.0:1789597206.423336:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789597206.423348:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984951552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597206.423600:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597206.424358:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984951552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1006us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.424387:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789597206.424491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.424566:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961763712 00000100:00100000:1.0:1789597206.424574:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961763712 00000100:00100000:0.0:1789597206.424735:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:0.0:1789597206.424748:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+8:18686:x1876527961763712:12345-192.168.202.16@tcp:36:lfs.0 00010000:00010000:0.0:1789597206.424818:0:25157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789597206.424855:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da200/0x7b5398e289bc0917 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f65 expref: 8 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.424877:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:0.0:1789597206.424894:0:25157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789597206.424925:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.424942:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.424954:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789597206.425276:0:25157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000315d2a4b reply state 00000000ddde0722 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.425292:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.425299:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:0.0:1789597206.425302:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789597206.425306:0:25157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789597206.425314:0:25157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789597206.425413:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+9:18686:x1876527961763712:12345-192.168.202.16@tcp:36:lfs.0 Request processed in 668us (925us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789597206.425420:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 33 00000100:00100000:3.0:1789597206.428613:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.429042:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789597206.429136:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789597206.429228:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597206.429308:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961763968 00000100:00100000:1.0:1789597206.429317:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961763968 00000100:00100000:1.0:1789597206.429385:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:1.0:1789597206.429396:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+9:18686:x1876527961763968:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789597206.429708:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+10:18686:x1876527961763968:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 312us (1109us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789597206.429717:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789597206.429818:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d836ae9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789597206.430272:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951680 00000100:00100000:0.0:1789597206.430280:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951680 00000100:00100000:0.0:1789597206.430362:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789597206.430372:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984951680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.430534:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984951680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.430542:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789597206.430652:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789597206.431768:0:25662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789597206.432130:0:22610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789597206.432164:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789597206.432177:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da600/0x7b5398e289bc0948 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc094f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.432192:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7eb98da600/0x7b5398e289bc0948 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc094f expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789597206.432205:0:22610:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789597206.432209:0:22610:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7d83162800 from 13 10000000:01000000:2.0:1789597206.432212:0:22610:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789597206.432278:0:22610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc095d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.432288:0:22610:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc095d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.432301:0:22610:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc095d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597206.432334:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebe1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789597206.432414:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597206.432722:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597206.432872:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951808 00000100:00100000:1.0:1789597206.432891:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951808 00000100:00100000:1.0:1789597206.432943:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789597206.432953:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+23:22610:x1876527984951808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597206.432971:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597206.432986:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a0a00/0x7b5398e289bc0964 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7b5398e289bc095d expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.433015:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a0a00/0x7b5398e289bc0964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7b5398e289bc095d expref: 24 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.433028:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a0a00/0x7b5398e289bc0964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7b5398e289bc095d expref: 24 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.433052:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0a00, rc 0) 00000100:00100000:1.0:1789597206.433233:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984951808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.433240:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789597206.433331:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebe1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789597206.433349:0:22610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc095d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0964 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.433360:0:22610:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc095d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7b5398e289bc0964 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597206.433440:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebe1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789597206.433470:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597206.433501:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597206.433542:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984951936 00000100:00100000:1.0:1789597206.433547:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984951936 00000100:00100000:1.0:1789597206.433567:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789597206.433573:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984951936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789597206.433755:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984951936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.433762:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789597206.433905:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebe1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984951936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789597206.433939:0:22610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebe1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984952064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789597206.433985:0:22610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597206.434010:0:22610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9670a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789597206.434163:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984952064 00000100:00100000:1.0:1789597206.434168:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984952064 00000100:00100000:1.0:1789597206.434188:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789597206.434194:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984952064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789597206.434286:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:22610:x1876527984952064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.434293:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789597206.434865:0:22610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebe1b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:980ee822-f655-4df0-a283-f316bd6c264b:22610:1876527984952064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789597206.435957:0:25663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789597206.436330:0:22610:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789597206.436361:0:22610:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789597206.436375:0:22610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc095d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0964 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.436389:0:22610:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.116@tcp lock: ffff9c7d833dca00/0x7b5398e289bc095d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7b5398e289bc0964 expref: -99 pid: 22610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597206.439433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.439502:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961764224 00000100:00100000:3.0:1789597206.439516:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961764224 00000100:00100000:3.0:1789597206.439582:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1789597206.439593:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+10:18686:x1876527961764224:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1789597206.439633:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789597206.439671:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc096b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f73 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.439837:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.439855:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.439870:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.439892:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.439902:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.439910:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789597206.440049:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789597206.440313:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440322:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440329:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440335:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597206.440340:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440359:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440374:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:3.0:1789597206.440378:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597206.440384:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440390:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db600/0x7b5398e289bc0972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440404:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440410:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440416:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440421:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597206.440424:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440431:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440439:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7e82a39900) 00010000:00010000:3.0:1789597206.440442:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789597206.440445:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440462:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0979 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440507:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc096b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f73 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440518:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:3.0:1789597206.440520:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789597206.440525:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc096b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f73 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.440534:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb98db400, rc 0) 00000100:00100000:3.0:1789597206.440622:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+11:18686:x1876527961764224:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1029us (1201us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1789597206.440629:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 34 00000100:00100000:3.0:1789597206.445281:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.445389:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961764352 00000100:00100000:0.0:1789597206.445402:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961764352 00000100:00100000:0.0:1789597206.445511:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:0.0:1789597206.445524:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+11:18686:x1876527961764352:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1789597206.445558:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597206.445585:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0987 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f7a expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.445771:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.445790:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.445806:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789597206.445839:0:25157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789597206.445843:0:25157:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789597206.445907:0:25157:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.445943:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0987 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 13 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.445976:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 12 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.445987:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:0.0:1789597206.445990:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789597206.445995:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4200, rc 0) 00000100:00100000:0.0:1789597206.446283:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be7b4031-1e67-4349-a0a6-83f95986ed0a+12:18686:x1876527961764352:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 759us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.446292:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 35 00000100:00100000:2.0:1789597206.457351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.457469:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961764480 00000100:00100000:1.0:1789597206.457482:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961764480 00000100:00100000:1.0:1789597206.457560:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:1.0:1789597206.457572:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+12:18686:x1876527961764480:12345-192.168.202.16@tcp:37:lfs.0 00000100:00100000:1.0:1789597206.464060:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+12:18686:x1876527961764480:12345-192.168.202.16@tcp:37:lfs.0 Request processed in 6473us (6709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.464169:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3 00000100:00100000:3.0:1789597206.467966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.468222:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961764736 00000100:00100000:0.0:1789597206.468235:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961764736 00000100:00100000:0.0:1789597206.468308:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:0.0:1789597206.468319:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+12:18686:x1876527961764736:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1789597206.468666:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+13:18686:x1876527961764736:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 345us (725us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1789597206.468675:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4 00000100:00100000:2.0:1789597206.501053:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.501599:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961764864 00000100:00100000:3.0:1789597206.501612:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961764864 00000100:00100000:2.0:1789597206.502073:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789597206.502085:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+11:18692:x1876527961764864:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789597206.502125:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597206.502153:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc0995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f81 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502240:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502258:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502272:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502287:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502295:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502320:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502423:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd400/0x7b5398e289bc09aa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502433:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd400/0x7b5398e289bc09aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502441:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd400/0x7b5398e289bc09aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597206.502497:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789597206.502502:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597206.502555:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd400/0x7b5398e289bc09aa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502572:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502579:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502587:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502592:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dc800 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.502596:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502602:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502756:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:2.0:1789597206.502759:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.502765:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502771:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc099c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502783:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502786:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502790:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502793:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833dcc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597206.502795:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502798:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502803:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7e82a39900) 00010000:00010000:2.0:1789597206.502804:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597206.502806:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502809:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502844:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc0995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f81 expref: 13 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502860:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd400/0x7b5398e289bc09aa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f81 expref: 12 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.502868:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:2.0:1789597206.502870:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789597206.502874:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dd400, rc 0) 00000100:00100000:2.0:1789597206.503051:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+12:18692:x1876527961764864:12345-192.168.202.16@tcp:101:bash.0 Request processed in 968us (2014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597206.503059:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 36 00000100:00100000:2.0:1789597206.507594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.507751:0:22624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961764992 00000100:00100000:1.0:1789597206.507764:0:22624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961764992 00000100:00100000:1.0:1789597206.507833:0:22624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1789597206.507845:0:22624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7df745ac-3f71-492a-842b-2e7c88612cac+5:18692:x1876527961764992:12345-192.168.202.16@tcp:900:bash.0 00000100:00100000:1.0:1789597206.507968:0:22624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7df745ac-3f71-492a-842b-2e7c88612cac+5:18692:x1876527961764992:12345-192.168.202.16@tcp:900:bash.0 Request processed in 124us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.507977:0:22624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:3.0:1789597206.511181:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.511364:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961765248 00000100:00100000:1.0:1789597206.511377:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961765248 00000100:00100000:1.0:1789597206.511447:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:1.0:1789597206.511459:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+12:18692:x1876527961765248:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:1.0:1789597206.511490:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597206.511516:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bc09b1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f88 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.511645:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.511659:0:22614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 12 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.511667:0:22614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.511741:0:22614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 12 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.511774:0:22614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 12 pid: 25157 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597206.511787:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952192:192.168.202.16@tcp:104: 00000100:00100000:1.0:1789597206.511874:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789597206.516030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597206.516186:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961765376 00000100:00100000:3.0:1789597206.516198:0:22599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961765376 00000100:00100000:1.0:1789597206.516237:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952192:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789597206.516247:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 13 pid: 25157 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.516269:0:22614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597206.516299:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 16 00000100:00100000:3.0:1789597206.516310:0:22599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+13:2409:x1876527961765376:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597206.516352:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597206.516361:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 13 pid: 25157 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.516375:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 13 pid: 25157 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.516403:0:22599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc098e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f7a expref: 13 pid: 25157 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.516431:0:22599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:3.0:1789597206.516436:0:22599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.516446:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.516453:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597206.516476:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789597206.516499:0:22614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.516506:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.516535:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597206.516545:0:22599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+12:2409:x1876527961765376:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 237us (531us total) trans 0 rc 0/0 00010000:00010000:1.0:1789597206.516546:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597206.516554:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 16 00010000:00010000:1.0:1789597206.516555:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518315:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518335:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518356:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597206.518369:0:22614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789597206.518396:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518401:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518406:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518410:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789597206.518414:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518419:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518428:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:1.0:1789597206.518430:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789597206.518434:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518438:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09b8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789597206.518449:0:22614:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006efefe76 reply state 0000000064405ebf transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518466:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518470:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c7eb9ad5100) 00010000:00010000:1.0:1789597206.518472:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789597206.518474:0:22614:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789597206.518518:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bc09b1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 15 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518536:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 14 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.518543:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:1.0:1789597206.518545:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789597206.518547:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0800, rc 0) 00000100:00100000:1.0:1789597206.518743:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+15:18692:x1876527961765248:12345-192.168.202.16@tcp:101:bash.0 Request processed in 7285us (7576us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789597206.518753:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 37 00000100:00100000:0.0:1789597206.528878:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.529287:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961765504 00000100:00100000:1.0:1789597206.529301:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961765504 00000100:00100000:2.0:1789597206.529497:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:2.0:1789597206.529513:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+15:18692:x1876527961765504:12345-192.168.202.16@tcp:101:bash.0 00010000:00010000:2.0:1789597206.529546:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597206.529572:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc09d4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f8f expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.529794:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.529812:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.529823:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597206.530041:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789597206.530047:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597206.530076:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.530089:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.530134:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc09d4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 17 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.530156:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 16 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.530163:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597206.530166:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789597206.530169:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dcc00, rc 0) 00000100:00100000:2.0:1789597206.530283:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+16:18692:x1876527961765504:12345-192.168.202.16@tcp:101:bash.0 Request processed in 774us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597206.530289:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 38 00000100:00100000:2.0:1789597206.533563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.533854:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961765760 00000100:00100000:0.0:1789597206.533868:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961765760 00000100:00100000:0.0:1789597206.534002:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1789597206.534014:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7df745ac-3f71-492a-842b-2e7c88612cac+16:18692:x1876527961765760:12345-192.168.202.16@tcp:35:bash.0 00000100:00100000:0.0:1789597206.534446:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7df745ac-3f71-492a-842b-2e7c88612cac+17:18692:x1876527961765760:12345-192.168.202.16@tcp:35:bash.0 Request processed in 432us (894us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789597206.534456:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1789597206.628525:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597206.628833:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961766016 00000100:00100000:2.0:1789597206.628917:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961766016 00000100:00100000:2.0:1789597206.629079:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789597206.631156:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+17:18702:x1876527961766016:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1789597206.631196:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597206.631227:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc09e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f96 expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597206.631377:0:25157:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789597206.631501:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc09e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f96 expref: 19 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.631518:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7d8370bf00) 00010000:00010000:2.0:1789597206.631522:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789597206.631528:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc09e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f96 expref: 19 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.631544:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc800, rc 0) 00000100:00100000:2.0:1789597206.631840:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+18:18702:x1876527961766016:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 2748us (3328us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1789597206.631850:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 39 00000100:00100000:2.0:1789597206.638297:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.638456:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961766272 00000100:00100000:1.0:1789597206.638471:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961766272 00000100:00100000:1.0:1789597206.638552:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1789597206.638564:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+18:18702:x1876527961766272:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1789597206.638934:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+19:18702:x1876527961766272:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 369us (649us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1789597206.638943:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1789597206.692923:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.693082:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961766528 00000100:00100000:1.0:1789597206.693115:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961766528 00000100:00100000:1.0:1789597206.693210:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:1.0:1789597206.693224:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+19:18705:x1876527961766528:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1789597206.693263:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597206.693293:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bc09f0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07f9d expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.693460:0:22615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.693477:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.693492:0:22615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597206.693506:0:22615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789597206.693652:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0200/0x7b5398e289bc09f0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f9d expref: 22 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.694032:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f9d expref: 21 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.694046:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:1.0:1789597206.694050:0:22615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789597206.694054:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1e00, rc 0) 00000100:00100000:1.0:1789597206.694159:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+21:18705:x1876527961766528:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 937us (1249us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1789597206.694189:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 40 00000100:00100000:3.0:1789597206.697087:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.697156:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961766656 00000100:00100000:3.0:1789597206.697169:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597206.697169:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961766656 00000100:00100000:2.0:1789597206.697287:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789597206.697302:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7df745ac-3f71-492a-842b-2e7c88612cac+21:2408:x1876527961766656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597206.697323:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597206.697356:0:22598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1e00/0x7b5398e289bc09f7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f9d expref: 21 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597206.697379:0:22598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597206.697386:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597206.697461:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7df745ac-3f71-492a-842b-2e7c88612cac+20:2408:x1876527961766656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 164us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597206.697469:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:0.0:1789597206.700981:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961766784 00000100:00100000:0.0:1789597206.701006:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961766784 00000100:00100000:0.0:1789597206.701106:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:0.0:1789597206.701128:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+20:18705:x1876527961766784:12345-192.168.202.16@tcp:54:lfs.0 00010000:00010000:0.0:1789597206.701245:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701268:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701283:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701329:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701336:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701343:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701349:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597206.701354:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701386:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701401:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:0.0:1789597206.701405:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789597206.701411:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597206.701418:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a05 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597206.701557:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+20:18705:x1876527961766784:12345-192.168.202.16@tcp:54:lfs.0 Request processed in 431us (4385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.701566:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 41 00000100:00100000:3.0:1789597206.704833:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597206.706187:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961767040 00000100:00100000:2.0:1789597206.706209:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961767040 00000100:00100000:2.0:1789597206.706305:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:2.0:1789597206.706318:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+20:18705:x1876527961767040:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1789597206.706651:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+21:18705:x1876527961767040:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 335us (1834us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1789597206.706660:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00010000:00010000:2.0:1789597206.717136:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789597206.976905:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597206.976942:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984952320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789597206.977014:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597206.977151:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961767168 00000100:00100000:1.0:1789597206.977162:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961767168 00000100:00100000:1.0:1789597206.977231:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:1.0:1789597206.977244:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+11:18049:x1876527961767168:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597206.977265:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597206.977289:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a0200/0x7b5398e289bc0a0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fa4 expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.977327:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a0200/0x7b5398e289bc0a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fa4 expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.977340:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a0200/0x7b5398e289bc0a0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fa4 expref: 12 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597206.977351:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0200, rc 0) 00000100:00100000:1.0:1789597206.977410:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+12:18049:x1876527961767168:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 168us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597206.977417:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:3.0:1789597206.977593:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984952320 00000100:00100000:3.0:1789597206.977598:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984952320 00000100:00100000:3.0:1789597206.977645:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789597206.977653:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984952320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789597206.977706:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789597206.977759:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984952320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597206.977766:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789597206.978014:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984952320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789597206.984740:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597206.984860:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961767296 00000100:00100000:0.0:1789597206.984875:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961767296 00000100:00100000:0.0:1789597206.984964:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:0.0:1789597206.984976:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+12:18049:x1876527961767296:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789597206.985195:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+12:18049:x1876527961767296:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 220us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597206.985203:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:3.0:1789597207.000082:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597207.000244:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961767424 00000100:00100000:2.0:1789597207.000259:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961767424 00000100:00100000:2.0:1789597207.000340:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:2.0:1789597207.000353:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+12:18049:x1876527961767424:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789597207.000789:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+12:18049:x1876527961767424:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 436us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597207.000799:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:3.0:1789597207.019959:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597207.020058:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597207.020123:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961767552 00000100:00100000:1.0:1789597207.020136:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961767552 00000100:00100000:1.0:1789597207.020233:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:1.0:1789597207.020253:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+12:18049:x1876527961767552:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789597207.020277:0:22607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597207.020304:0:22607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7e869a0c00/0x7b5398e289bc0a13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fab expref: -99 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.020353:0:22607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7e869a0c00/0x7b5398e289bc0a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fab expref: 13 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.020369:0:22607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7e869a0c00/0x7b5398e289bc0a13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fab expref: 13 pid: 22607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.020378:0:22607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0c00, rc 0) 00000100:00100000:1.0:1789597207.020448:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92535339-8580-4a0b-a747-d4b79f5081f6+13:18049:x1876527961767552:12345-192.168.202.16@tcp:101:ll_cfg_requeue.0 Request processed in 202us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597207.020456:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:2.0:1789597207.021212:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961767808 00000100:00100000:2.0:1789597207.021232:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961767808 00000100:00100000:2.0:1789597207.021294:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:2.0:1789597207.021303:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+21:18736:x1876527961767808:12345-192.168.202.16@tcp:101:cat.0 00010000:00010000:2.0:1789597207.021329:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597207.021348:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc0a1a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fb2 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.021525:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc0a21 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.021542:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc0a21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.021557:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc0a21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597207.021570:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789597207.021800:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dd200/0x7b5398e289bc0a1a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fb2 expref: 24 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.021824:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc0a21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fb2 expref: 23 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.021834:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597207.021838:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789597207.021842:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d833dc800, rc 0) 00000100:00100000:2.0:1789597207.021910:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+23:18736:x1876527961767808:12345-192.168.202.16@tcp:101:cat.0 Request processed in 608us (1851us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1789597207.021918:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 42 00000100:00100000:3.0:1789597207.029383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597207.029618:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961767936 00000100:00100000:1.0:1789597207.029644:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961767936 00000100:00100000:1.0:1789597207.029756:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:1.0:1789597207.029770:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:18049:x1876527961767936:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789597207.030378:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:18049:x1876527961767936:12345-192.168.202.16@tcp:501:ll_cfg_requeue.0 Request processed in 608us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597207.030389:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:3.0:1789597207.031048:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597207.031160:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961768192 00000100:00100000:3.0:1789597207.031170:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961768192 00000100:00100000:2.0:1789597207.032317:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1789597207.032341:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+23:18736:x1876527961768192:12345-192.168.202.16@tcp:35:cat.0 00000100:00100000:2.0:1789597207.033236:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+24:18736:x1876527961768192:12345-192.168.202.16@tcp:35:cat.0 Request processed in 898us (2189us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1789597207.033267:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:1.0:1789597207.034376:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597207.034461:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597207.034500:0:22606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961768448 00000100:00100000:1.0:1789597207.034509:0:22606:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961768448 00000100:00100000:1.0:1789597207.034558:0:22606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:1.0:1789597207.034568:0:22606:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+13:18049:x1876527961768448:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789597207.034753:0:22606:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7bb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92535339-8580-4a0b-a747-d4b79f5081f6+13:18049:x1876527961768448:12345-192.168.202.16@tcp:503:ll_cfg_requeue.0 Request processed in 187us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597207.034772:0:22606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:3.0:1789597207.035623:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961768320 00000100:00100000:3.0:1789597207.035637:0:22599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961768320 00000100:00100000:3.0:1789597207.035718:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:3.0:1789597207.035727:0:22599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7df745ac-3f71-492a-842b-2e7c88612cac+24:2408:x1876527961768320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789597207.035741:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597207.035771:0:22599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dc800/0x7b5398e289bc0a21 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fb2 expref: 24 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597207.035795:0:22599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:3.0:1789597207.035802:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789597207.035850:0:22599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7df745ac-3f71-492a-842b-2e7c88612cac+23:2408:x1876527961768320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 115us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597207.035868:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00000040:00080000:1.0:1789597207.101527:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789597207.103514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597207.104260:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961768704 00000100:00100000:0.0:1789597207.104276:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961768704 00000100:00100000:0.0:1789597207.104366:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:0.0:1789597207.104378:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+23:18744:x1876527961768704:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1789597207.104414:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597207.104443:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a2f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fb9 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597207.104636:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597207.104654:0:22614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 24 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597207.104663:0:22614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 24 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597207.104672:0:22614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597207.104752:0:22614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 24 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597207.104767:0:22614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 24 pid: 22613 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597207.104783:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952448:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789597207.104904:0:22614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 24 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597207.104914:0:22614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 24 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597207.104923:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952576:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789597207.104953:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ebb17f600 going to sleep for 11 seconds 00000100:00100000:0.0:1789597207.108790:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952448:192.168.202.16@tcp:104: 00000100:00100000:0.0:1789597207.108813:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d837b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952576:192.168.202.16@tcp:104: 00010000:00010000:0.0:1789597207.108850:0:22614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597207.121129:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597207.121190:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597207.121343:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961768832 00000100:00100000:2.0:1789597207.121358:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961768832 00010000:00010000:2.0:1789597207.121418:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 25 pid: 22613 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597207.121465:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961768960 00000100:00100000:2.0:1789597207.121469:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961768960 00010000:00010000:2.0:1789597207.121485:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 26 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597207.121503:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1789597207.121514:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+26:2408:x1876527961768832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597207.121533:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597207.121541:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 26 pid: 22613 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121558:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 26 pid: 22613 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121601:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833dcc00/0x7b5398e289bc09db lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f8f expref: 26 pid: 22613 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121635:0:22600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597207.121642:0:22600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121744:0:22600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121753:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597207.121819:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+25:2408:x1876527961768832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 306us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597207.121828:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 17 00000100:00100000:2.0:1789597207.121848:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 18 00000100:00100000:2.0:1789597207.121855:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83178850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+24:2408:x1876527961768960:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597207.121863:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597207.121868:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 24 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121879:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 24 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121892:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0800/0x7b5398e289bc09c6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07f88 expref: 24 pid: 22614 timeout: 881 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121903:0:22600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597207.121906:0:22600:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121915:0:22600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121924:0:22600:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.121962:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597207.121983:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83178850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+23:2408:x1876527961768960:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 127us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597207.121990:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 18 00010000:00010000:2.0:1789597207.122050:0:22614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.122059:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597207.122083:0:22614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789597207.122361:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a2f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fb9 expref: 24 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.122390:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4200/0x7b5398e289bc0a36 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fb9 expref: 23 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.122399:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597207.122402:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789597207.122404:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4200, rc 0) 00000100:00100000:2.0:1789597207.122434:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+23:18744:x1876527961768704:12345-192.168.202.16@tcp:101:dd.0 Request processed in 18058us (18936us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1789597207.122442:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 43 00000100:00100000:2.0:1789597207.126030:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597207.126118:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961769088 00000100:00100000:1.0:1789597207.126134:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961769088 00000100:00100000:1.0:1789597207.126211:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:1.0:1789597207.126230:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+23:18744:x1876527961769088:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1789597207.126261:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597207.126288:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a44 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fc0 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.126332:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.126348:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.126361:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.126528:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 25 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.126548:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 24 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.126568:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:1.0:1789597207.126571:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789597207.126575:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1000, rc 0) 00000100:00100000:1.0:1789597207.126652:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+24:18744:x1876527961769088:12345-192.168.202.16@tcp:101:dd.0 Request processed in 431us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597207.126660:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 44 00000100:00100000:3.0:1789597207.135636:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597207.135935:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961769344 00000100:00100000:2.0:1789597207.135951:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961769344 00000100:00100000:2.0:1789597207.136038:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 45 00000100:00100000:2.0:1789597207.136052:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+24:18744:x1876527961769344:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:2.0:1789597207.136494:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.136523:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.136539:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789597207.136595:0:25157:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789597207.136622:0:25157:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1af697d reply state 00000000f0659450 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.136636:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.136645:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597207.136648:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789597207.136653:0:25157:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789597207.136873:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+27:18744:x1876527961769344:12345-192.168.202.16@tcp:36:dd.0 Request processed in 821us (1255us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789597207.136882:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 45 00000020:00080000:2.0:1789597207.136888:0:25157:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789597207.142029:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597207.142169:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961769472 00000100:00100000:1.0:1789597207.142183:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961769472 00000100:00100000:1.0:1789597207.142266:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:1.0:1789597207.142279:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+27:18744:x1876527961769472:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1789597207.142313:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597207.142342:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a59 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fc7 expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.142442:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc7 expref: 28 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.142461:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc7 expref: 28 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597207.142487:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:1.0:1789597207.142491:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789597207.142496:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1400, rc 0) 00000100:00100000:1.0:1789597207.142578:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+28:18744:x1876527961769472:12345-192.168.202.16@tcp:101:dd.0 Request processed in 300us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597207.142586:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 46 00000100:00100000:3.0:1789597207.164517:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000040:00080000:1.0:1789597207.165433:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789597207.165765:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961769728 00000100:00100000:2.0:1789597207.165787:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961769728 00000100:00100000:2.0:1789597207.165897:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:2.0:1789597207.165911:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+28:18744:x1876527961769728:12345-192.168.202.16@tcp:103:dd.0 00010000:00010000:2.0:1789597207.165933:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597207.165970:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a59 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc7 expref: 28 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.166016:0:22600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597207.166024:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597207.166130:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+27:18744:x1876527961769728:12345-192.168.202.16@tcp:103:dd.0 Request processed in 221us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597207.166139:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2 00000100:00100000:3.0:1789597207.172674:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597207.172853:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961769856 00000100:00100000:2.0:1789597207.172871:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961769856 00000100:00100000:2.0:1789597207.172966:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:2.0:1789597207.172978:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+27:18744:x1876527961769856:12345-192.168.202.16@tcp:58:dd.0 00010000:00010000:2.0:1789597207.173151:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.173173:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.173187:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789597207.176115:0:25157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789597207.176161:0:25157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789597207.176315:0:25157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789597207.176457:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+27:18744:x1876527961769856:12345-192.168.202.16@tcp:58:dd.0 Request processed in 3473us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597207.176469:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 47 00000100:00100000:1.0:1789597207.181764:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597207.182976:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961769984 00000100:00100000:2.0:1789597207.182995:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961769984 00000100:00100000:2.0:1789597207.183134:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48 00000100:00100000:2.0:1789597207.183148:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+27:18744:x1876527961769984:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1789597207.183181:0:22613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597207.183210:0:22613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fce expref: -99 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.183288:0:22613:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.183319:0:22613:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 28 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.183343:0:22613:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.183359:0:22613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 28 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.183375:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597207.183379:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789597207.183383:0:22613:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 28 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597207.183392:0:22613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb7f4e200, rc 0) 00000100:00100000:2.0:1789597207.183482:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+28:18744:x1876527961769984:12345-192.168.202.16@tcp:101:dd.0 Request processed in 337us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597207.183489:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48 00010000:00010000:2.0:1789597207.741279:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789597208.191051:0:22649:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789597208.191065:0:22649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789597208.191231:0:22649:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789597208.191254:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789597208.191444:0:22649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22649:1876527984952704:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789597208.191571:0:22649:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d83009180 going to sleep for 11 seconds 00000100:00100000:1.0:1789597208.195809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.196064:0:22649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d83dedf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22649:1876527984952704:192.168.202.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789597208.200079:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961770112 00000100:00100000:0.0:1789597208.200120:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961770112 00000100:00100000:0.0:1789597208.200262:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00100000:0.0:1789597208.200281:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+28:18745:x1876527961770112:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789597208.200330:0:22614:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789597208.200530:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+28:18745:x1876527961770112:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 255us (4737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597208.200538:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 49 00000100:00080000:3.0:1789597208.203850:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789597208.204660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.205139:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961770240 00000100:00100000:0.0:1789597208.205153:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961770240 00000100:00100000:2.0:1789597208.205315:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:2.0:1789597208.205329:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+28:18745:x1876527961770240:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789597208.205447:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.205496:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.205511:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.206963:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.206987:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207001:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207034:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207045:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207052:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597208.207120:0:22613:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789597208.207125:0:22613:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597208.207150:0:22613:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207163:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207189:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207195:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207200:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4ea00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.207205:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207214:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207227:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39800) 00010000:00010000:2.0:1789597208.207239:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597208.207245:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207251:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0a6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207268:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207273:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207278:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207283:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4e600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.207292:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207299:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207307:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9c7e82a39b00) 00010000:00010000:2.0:1789597208.207309:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597208.207313:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207318:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0a75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207334:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207340:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207346:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207352:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4ee00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.207355:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207361:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207367:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597208.207370:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597208.207378:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.207384:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ee00/0x7b5398e289bc0a7c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.207476:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+28:18745:x1876527961770240:12345-192.168.202.16@tcp:34:lhsmtool_posix.0 Request processed in 2146us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.207487:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 50 00000100:00100000:1.0:1789597208.212433:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.212824:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961770496 00000100:00100000:0.0:1789597208.212838:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961770496 00000100:00100000:0.0:1789597208.212990:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:0.0:1789597208.213004:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+28:18745:x1876527961770496:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789597208.213127:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597208.213176:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0a83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fd5 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231617:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231663:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231692:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789597208.231708:0:22614:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789597208.231834:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231842:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231851:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231857:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:1.0:1789597208.231862:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231903:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231918:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:1.0:1789597208.231921:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789597208.231927:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.231933:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0a8a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.232008:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0a83 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fd5 expref: 30 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.232022:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7e82a39800) 00010000:00010000:1.0:1789597208.232025:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789597208.232029:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e4000/0x7b5398e289bc0a83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fd5 expref: 30 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.232055:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7ead4e4000, rc 0) 00000100:00100000:1.0:1789597208.232167:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+29:18745:x1876527961770496:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 19164us (19746us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1789597208.232179:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 51 00000100:00100000:1.0:1789597208.236710:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.236915:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961770624 00000100:00100000:0.0:1789597208.236930:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961770624 00000100:00100000:0.0:1789597208.237011:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:0.0:1789597208.237025:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+29:18745:x1876527961770624:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789597208.237077:0:22615:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789597208.237265:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+29:18745:x1876527961770624:12345-192.168.202.16@tcp:53:lhsmtool_posix.0 Request processed in 243us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597208.237274:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 52 00000100:00100000:2.0:1789597208.240762:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.242335:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961770880 00000100:00100000:0.0:1789597208.242351:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961770880 00000100:00100000:0.0:1789597208.242509:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:0.0:1789597208.242521:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebe1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+29:18745:x1876527961770880:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789597208.242549:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597208.242577:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a98 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fdc expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789597208.243162:0:25157:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:0.0:1789597208.243172:0:25157:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:0.0:1789597208.243197:0:25157:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1789597208.243398:0:25157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bc0a9f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.243416:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bc0a9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.243429:0:25157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bc0a9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.243527:0:25157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5c00/0x7b5398e289bc0a98 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fdc expref: 32 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.243562:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bc0a9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fdc expref: 31 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.243572:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7d833d8700) 00010000:00010000:0.0:1789597208.243576:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789597208.243580:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83743600, rc 0) 00000100:00100000:0.0:1789597208.243852:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebe1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+31:18745:x1876527961770880:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 1332us (3106us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1789597208.243872:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 53 00000100:00100000:1.0:1789597208.253586:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.253997:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961771136 00000100:00100000:2.0:1789597208.254023:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961771136 00000100:00100000:2.0:1789597208.254127:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789597208.254140:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+31:18745:x1876527961771136:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789597208.254251:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597208.254286:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83743600/0x7b5398e289bc0a9f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fdc expref: 31 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254319:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7d833d8700) 00010000:00010000:2.0:1789597208.254331:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789597208.254365:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254382:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254393:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254409:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254425:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254432:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254498:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254506:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254512:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254518:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4e600 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.254524:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254532:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254540:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:2.0:1789597208.254543:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597208.254547:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254553:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e600/0x7b5398e289bc0aad lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254562:0:22613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254575:0:22613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254581:0:22613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254587:0:22613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4ea00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.254590:0:22613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254597:0:22613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254605:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x34bd9be2 (ffff9c7e82a39b00) 00010000:00010000:2.0:1789597208.254608:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597208.254611:0:22613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.254631:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ab4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x34bd9be2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.254808:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+30:18745:x1876527961771136:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 669us (1235us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789597208.254816:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 54 00000100:00100000:2.0:1789597208.261437:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597208.261554:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961771264 00000100:00100000:1.0:1789597208.261569:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961771264 00000100:00100000:1.0:1789597208.261656:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:1.0:1789597208.261728:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+30:18745:x1876527961771264:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789597208.261768:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597208.261806:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0abb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fe3 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.261858:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0ac2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.261886:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0ac2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.261902:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0ac2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.262272:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1400/0x7b5398e289bc0abb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fe3 expref: 32 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.262296:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a0400/0x7b5398e289bc0ac2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fe3 expref: 31 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.262307:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:1.0:1789597208.262310:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789597208.262314:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a0400, rc 0) 00000100:00100000:1.0:1789597208.262405:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+31:18745:x1876527961771264:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 681us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597208.262414:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 55 00000100:00100000:3.0:1789597208.280512:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.289737:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961771520 00000100:00100000:2.0:1789597208.289763:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961771520 00000100:00100000:2.0:1789597208.289853:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:2.0:1789597208.290292:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+31:18745:x1876527961771520:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789597208.290437:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.290458:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.290473:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789597208.291192:0:22613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1789597208.291209:0:22613:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 783109530105ns, next at 784109526218ns, rc = 0 00000004:00010000:2.0:1789597208.291284:0:22613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000888375ae reply state 0000000060a89514 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.291302:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.291312:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:2.0:1789597208.291315:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789597208.291322:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789597208.291496:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+33:18745:x1876527961771520:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 1627us (10993us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1789597208.291506:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 56 00000100:00100000:3.0:1789597208.295532:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.295665:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961771648 00000100:00100000:0.0:1789597208.295720:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961771648 00000100:00100000:0.0:1789597208.295781:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:0.0:1789597208.295791:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+33:18745:x1876527961771648:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789597208.295822:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789597208.295849:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fea expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.296260:0:25157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 34 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.296281:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 34 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.296337:0:25157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:0.0:1789597208.296341:0:25157:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789597208.296346:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7d83742000, rc 0) 00000100:00100000:0.0:1789597208.296554:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+34:18745:x1876527961771648:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 762us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597208.296563:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 57 00000100:00100000:1.0:1789597208.308537:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.308717:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961771776 00000100:00100000:2.0:1789597208.308732:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961771776 00000100:00100000:2.0:1789597208.308826:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789597208.308840:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7df745ac-3f71-492a-842b-2e7c88612cac+5:2408:x1876527961771776:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789597208.309743:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7df745ac-3f71-492a-842b-2e7c88612cac+6:2408:x1876527961771776:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 898us (1215us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1789597208.309780:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00080000:3.0:1789597208.310167:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597208.325212:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.325407:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961772032 00000100:00100000:0.0:1789597208.325421:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961772032 00000100:00100000:0.0:1789597208.325497:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:0.0:1789597208.325510:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7df745ac-3f71-492a-842b-2e7c88612cac+34:18745:x1876527961772032:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789597208.325882:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7df745ac-3f71-492a-842b-2e7c88612cac+35:18745:x1876527961772032:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 373us (685us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1789597208.325891:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1789597208.330498:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.330630:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961772288 00000100:00100000:0.0:1789597208.330644:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961772288 00000100:00100000:0.0:1789597208.330757:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:0.0:1789597208.330769:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+35:18745:x1876527961772288:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789597208.332012:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+35:18745:x1876527961772288:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 1233us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597208.332026:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 58 00000100:00100000:1.0:1789597208.339154:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.339320:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961772416 00000100:00100000:2.0:1789597208.339334:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961772416 00000100:00100000:2.0:1789597208.339465:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1789597208.339479:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e869bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+35:18745:x1876527961772416:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789597208.339507:0:22614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789597208.339534:0:22614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0ad7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ff1 expref: -99 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.339828:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4f400/0x7b5398e289bc0ade lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.339848:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4f400/0x7b5398e289bc0ade lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.339863:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4f400/0x7b5398e289bc0ade lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789597208.339989:0:22614:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789597208.340126:0:22614:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4f400/0x7b5398e289bc0ade lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.340164:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0ad7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff1 expref: 37 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.340187:0:22614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4f400/0x7b5398e289bc0ade lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff1 expref: 36 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.340213:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:2.0:1789597208.340217:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789597208.340222:0:22614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7eb7f4f400, rc 0) 00000100:00100000:2.0:1789597208.340355:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e869bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+36:18745:x1876527961772416:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 878us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.340364:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 59 00000100:00100000:2.0:1789597208.344847:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597208.345365:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961772544 00000100:00100000:1.0:1789597208.345379:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961772544 00000100:00100000:1.0:1789597208.345455:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789597208.345466:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7df745ac-3f71-492a-842b-2e7c88612cac+6:2409:x1876527961772544:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789597208.345490:0:24122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597208.345516:0:24122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07ff8 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789597208.345551:0:24122:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab1618, blocks: 0x0 00010000:00010000:1.0:1789597208.345579:0:24122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=783s v=(0 0) 00010000:00010000:1.0:1789597208.345584:0:24122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597208.345597:0:24122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 7 pid: 24122 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.345851:0:24122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 7 pid: 24122 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.345878:0:24122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1e00, rc 0) 00000100:00100000:1.0:1789597208.345965:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7df745ac-3f71-492a-842b-2e7c88612cac+7:2409:x1876527961772544:12345-192.168.202.16@tcp:101:lhsmtool_posix.0 Request processed in 500us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597208.345973:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:1.0:1789597208.349390:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.349539:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961772800 00000100:00100000:2.0:1789597208.349553:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961772800 00000100:00100000:2.0:1789597208.349641:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789597208.349653:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+36:18745:x1876527961772800:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789597208.349874:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+36:18745:x1876527961772800:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 213us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.349883:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 60 00000100:00100000:2.0:1789597208.353078:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.353173:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961772928 00000100:00100000:0.0:1789597208.353188:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961772928 00000100:00100000:0.0:1789597208.353262:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 61 00000100:00100000:0.0:1789597208.353275:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+36:18745:x1876527961772928:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789597208.356817:0:22593:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1789597208.356841:0:22593:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789597208.356911:0:22593:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1789597208.357162:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.357179:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.357190:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.357196:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7ead4e5e00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:3.0:1789597208.357202:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.357210:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.357231:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:3.0:1789597208.357235:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789597208.357241:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.357248:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7ead4e5e00/0x7b5398e289bc0956 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.357567:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984952832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789597208.357670:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597208.357877:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984952832 00000100:00100000:1.0:1789597208.357889:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984952832 00000100:00100000:1.0:1789597208.357971:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789597208.357981:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984952832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789597208.358179:0:24121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789597208.358183:0:24121:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789597208.358185:0:24121:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789597208.358187:0:24121:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789597208 -> 1789597208 00002000:00010000:1.0:1789597208.358190:0:24121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789597208.358245:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876527984952832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (576us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1789597208.358253:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1789597208.358313:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7e867e0380/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789597208.358321:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984952832:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1789597208.358526:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597208.359113:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7df745ac-3f71-492a-842b-2e7c88612cac+19:18745:x1876527961772928:12345-192.168.202.16@tcp:44:lhsmtool_posix.0 Request processed in 5835us (6042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.359124:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 61 00010000:00010000:0.0:1789597208.361455:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361478:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361486:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361493:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d833ddc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597208.361498:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361507:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361528:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9c7e82a39900) 00010000:00010000:0.0:1789597208.361531:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597208.361537:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361544:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d833ddc00/0x7b5398e289bc08d8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361577:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361584:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361590:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361604:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db200 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597208.361607:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361614:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361635:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9c7d8370b900) 00010000:00010000:0.0:1789597208.361637:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597208.361641:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361646:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db200/0x7b5398e289bc08df lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361664:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361669:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361674:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361698:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7e869a1c00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597208.361701:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361707:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361727:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9c7eb9ad5100) 00010000:00010000:0.0:1789597208.361730:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597208.361733:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361739:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1c00/0x7b5398e289bc09bf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361758:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361764:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361769:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361774:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4e000 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597208.361777:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361782:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361789:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:0.0:1789597208.361791:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789597208.361794:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361799:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e000/0x7b5398e289bc0a52 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361821:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361827:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361833:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361837:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4ea00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:0.0:1789597208.361840:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361846:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361854:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:0.0:1789597208.361856:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789597208.361859:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.361865:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4ea00/0x7b5398e289bc0ac9 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597208.362571:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.362988:0:24573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961773056 00000100:00100000:2.0:1789597208.363014:0:24573:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961773056 00000100:00100000:2.0:1789597208.363133:0:24573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:2.0:1789597208.363146:0:24573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+7:2409:x1876527961773056:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789597208.363297:0:24573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7df745ac-3f71-492a-842b-2e7c88612cac+7:2409:x1876527961773056:12345-192.168.202.16@tcp:16:lhsmtool_posix.0 Request processed in 154us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.363305:0:24573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 28 00000100:00100000:1.0:1789597208.366228:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597208.366328:0:22613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961773312 00000100:00100000:3.0:1789597208.366343:0:22613:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961773312 00000100:00100000:3.0:1789597208.366417:0:22613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:3.0:1789597208.366430:0:22613:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+15:18745:x1876527961773312:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789597208.366506:0:22613:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789597208.366546:0:22613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4f400/0x7b5398e289bc0ade lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff1 expref: 15 pid: 22614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.366573:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:3.0:1789597208.366581:0:22613:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789597208.366632:0:22613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc0aec lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.366649:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc0aec lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.366660:0:22613:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc0aec lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789597208.367048:0:22613:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074d81624 reply state 0000000093d6a4f6 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc0aec lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.367064:0:22613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98daa00/0x7b5398e289bc0aec lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22613 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.367072:0:22613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:3.0:1789597208.367075:0:22613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789597208.367078:0:22613:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789597208.367222:0:22613:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7df745ac-3f71-492a-842b-2e7c88612cac+16:18745:x1876527961773312:12345-192.168.202.16@tcp:36:lhsmtool_posix.0 Request processed in 794us (1009us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1789597208.367249:0:22613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 62 00000100:00100000:3.0:1789597208.369666:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597208.369819:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961773440 00000100:00100000:1.0:1789597208.369833:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961773440 00000100:00100000:1.0:1789597208.369916:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1789597208.369928:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7df745ac-3f71-492a-842b-2e7c88612cac+7:2408:x1876527961773440:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789597208.370149:0:24121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789597208.370154:0:24121:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789597207 00002000:00010000:1.0:1789597208.370157:0:24121:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789597207 00002000:00010000:1.0:1789597208.370159:0:24121:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789597208 -> 1789597207 00002000:00010000:1.0:1789597208.370162:0:24121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1789597208.370237:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7df745ac-3f71-492a-842b-2e7c88612cac+8:2408:x1876527961773440:12345-192.168.202.16@tcp:2:lhsmtool_posix.0 Request processed in 310us (584us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789597208.370245:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 29 00000100:00100000:1.0:1789597208.373282:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.373384:0:24122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961773568 00000100:00100000:0.0:1789597208.373399:0:24122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961773568 00000100:00100000:0.0:1789597208.373472:0:24122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789597208.373484:0:24122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7df745ac-3f71-492a-842b-2e7c88612cac+8:2409:x1876527961773568:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789597208.373545:0:24122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373586:0:24122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597208.373591:0:24122:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789597208.373599:0:24122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373630:0:24122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373665:0:24122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373674:0:24122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373721:0:24122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373729:0:24122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7d83742c00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597208.373735:0:24122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373745:0:24122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373763:0:24122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.373780:0:24122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000481d8e35/0x7b5398e289bc0af3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597208.373945:0:24122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7df745ac-3f71-492a-842b-2e7c88612cac+8:2409:x1876527961773568:12345-192.168.202.16@tcp:1:lhsmtool_posix.0 Request processed in 463us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789597208.373953:0:24122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 30 00000100:00100000:0.0:1789597208.376605:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.376925:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961773824 00000100:00100000:2.0:1789597208.376940:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961773824 00000100:00100000:2.0:1789597208.377017:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:2.0:1789597208.377030:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+16:18745:x1876527961773824:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789597208.377157:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.377180:0:22614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 16 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.377190:0:22614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.377239:0:22614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 16 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.377262:0:22614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 16 pid: 22613 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.377279:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952960:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789597208.377391:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7d82699f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789597208.380274:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984952960:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789597208.380313:0:22614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597208.382388:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597208.382992:0:22598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961773952 00000100:00100000:1.0:1789597208.383027:0:22598:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961773952 00010000:00010000:1.0:1789597208.383092:0:22598:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 17 pid: 22613 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597208.383159:0:22598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 19 00000100:00100000:1.0:1789597208.383171:0:22598:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7df745ac-3f71-492a-842b-2e7c88612cac+17:2407:x1876527961773952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597208.383189:0:22598:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597208.383198:0:22598:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 17 pid: 22613 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.383213:0:22598:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 17 pid: 22613 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.383243:0:22598:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0a4b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fc0 expref: 17 pid: 22613 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.383264:0:22598:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:1.0:1789597208.383271:0:22598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 16 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.383283:0:22598:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.383292:0:22598:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.383300:0:22598:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.383356:0:22598:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789597208.383440:0:22598:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7df745ac-3f71-492a-842b-2e7c88612cac+16:2407:x1876527961773952:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 271us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597208.383447:0:22598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 19 00010000:00010000:3.0:1789597208.383942:0:22614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.383953:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.384248:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.384265:0:22614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 16 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.384274:0:22614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.384316:0:22614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 16 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.384332:0:22614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 16 pid: 25157 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597208.384348:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb5e41180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984953088:192.168.202.16@tcp:104: 00000100:00100000:3.0:1789597208.384438:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789597208.388300:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.388424:0:22599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961774080 00000100:00100000:2.0:1789597208.388437:0:22599:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961774080 00010000:00010000:2.0:1789597208.388490:0:22599:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 17 pid: 25157 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.388543:0:22599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 20 00000100:00100000:2.0:1789597208.388556:0:22599:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7df745ac-3f71-492a-842b-2e7c88612cac+17:2408:x1876527961774080:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789597208.388575:0:22599:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789597208.388583:0:22599:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 17 pid: 25157 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.388598:0:22599:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 17 pid: 25157 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.388935:0:22599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:2.0:1789597208.388943:0:22599:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.388954:0:22599:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.388963:0:22599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.388989:0:22599:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789597208.389079:0:22599:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7df745ac-3f71-492a-842b-2e7c88612cac+17:2408:x1876527961774080:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 525us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.389088:0:22599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 20 00010000:00010000:3.0:1789597208.389608:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7d83742000/0x7b5398e289bc0ad0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fea expref: 16 pid: 25157 timeout: 883 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789597208.389939:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb5e41180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984953088:192.168.202.16@tcp:104: 00010000:00010000:3.0:1789597208.389965:0:22614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.389975:0:22614:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.389980:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789597208.390134:0:22614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1789597208.390278:0:22614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1789597208.390323:0:22614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1789597208.390422:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb5e41180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22614:1876527984953216:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789597208.390506:0:22614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597208.390601:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7ea64cf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789597208.391596:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984953216 00000100:00100000:1.0:1789597208.391612:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984953216 00000100:00100000:1.0:1789597208.391848:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789597208.391862:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22614:x1876527984953216:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789597208.392156:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22614:x1876527984953216:12345-0@lo:1000:mdt00_001.0 Request processed in 295us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597208.392164:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789597208.392360:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb5e41180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22614:1876527984953216:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789597208.393160:0:22614:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1789597208.393290:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22614:1876527984953344:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789597208.393361:0:22614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597208.393442:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789597208.393957:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984953344 00000100:00100000:3.0:1789597208.393968:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984953344 00000100:00100000:3.0:1789597208.394085:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789597208.394107:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22614:x1876527984953344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789597208.394327:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22614:x1876527984953344:12345-0@lo:1000:mdt00_001.0 Request processed in 231us (965us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1789597208.394336:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789597208.394429:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22614:1876527984953344:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789597208.394485:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394496:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394504:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394510:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98db400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.394516:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394525:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394547:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:2.0:1789597208.394550:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789597208.394557:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394589:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98db400/0x7b5398e289bc0b01 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394649:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394657:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394661:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394665:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4fa00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.394667:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394672:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394706:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597208.394709:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789597208.394717:0:22614:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 19 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394730:0:22614:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 19 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394741:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 19 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.394824:0:22614:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e200/0x7b5398e289bc0a67 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fce expref: 19 pid: 22613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.394839:0:22614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984953472:192.168.202.16@tcp:105: 00000100:00100000:2.0:1789597208.394944:0:22614:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789597208.398491:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597208.398587:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961774208 00000100:00100000:1.0:1789597208.398600:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961774208 00000100:00100000:1.0:1789597208.399120:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1789597208.399135:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d84ebc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7df745ac-3f71-492a-842b-2e7c88612cac+20:18744:x1876527961774208:12345-192.168.202.16@tcp:49:dd.0 00000100:00100000:1.0:1789597208.399322:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d84ebc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7df745ac-3f71-492a-842b-2e7c88612cac+20:18744:x1876527961774208:12345-192.168.202.16@tcp:49:dd.0 Request processed in 191us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597208.399330:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:2.0:1789597208.399641:0:22614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22614:1876527984953472:192.168.202.16@tcp:105: 00010000:00010000:2.0:1789597208.399674:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399701:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fa00/0x7b5398e289bc0a60 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 25157 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399745:0:22614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399763:0:22614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399778:0:22614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399790:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399796:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399803:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399836:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4fc00 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.399841:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399849:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399864:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597208.399880:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789597208.399885:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399892:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4fc00/0x7b5398e289bc0b08 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399903:0:22614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399909:0:22614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399915:0:22614:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399920:0:22614:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4e400 already unused, calling callback (ffffffffc1a424f0) 00010000:00010000:2.0:1789597208.399923:0:22614:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399928:0:22614:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399948:0:22614:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:2.0:1789597208.399950:0:22614:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789597208.399954:0:22614:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.399960:0:22614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb7f4e400/0x7b5398e289bc0afa lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22614 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.400147:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+19:18745:x1876527961773824:12345-192.168.202.16@tcp:57:lhsmtool_posix.0 Request processed in 23118us (23555us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1789597208.400157:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000020:00080000:2.0:1789597208.400162:0:22614:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789597208.400341:0:22649:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789597208.400347:0:22649:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789597208.400382:0:22649:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789597208.400389:0:22649:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789597208.405978:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1789597208.406109:0:22615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961774336 00000100:00100000:1.0:1789597208.406124:0:22615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961774336 00000100:00100000:1.0:1789597208.406204:0:22615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:1.0:1789597208.406218:0:22615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+19:18744:x1876527961774336:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1789597208.406248:0:22615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789597208.406278:0:22615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0b0f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x93d69f46c9e07fff expref: -99 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.406352:0:22615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0b16 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.406371:0:22615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0b16 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.406386:0:22615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0b16 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.406538:0:22615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1000/0x7b5398e289bc0b0f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fff expref: 21 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.406561:0:22615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7e869a1800/0x7b5398e289bc0b16 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07fff expref: 20 pid: 22615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.406570:0:22615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9c7eb9ad5800) 00010000:00010000:1.0:1789597208.406574:0:22615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789597208.406579:0:22615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7e869a1800, rc 0) 00000100:00100000:1.0:1789597208.406735:0:22615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d837b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7df745ac-3f71-492a-842b-2e7c88612cac+20:18744:x1876527961774336:12345-192.168.202.16@tcp:101:dd.0 Request processed in 519us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597208.406742:0:22615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:0.0:1789597208.409668:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597208.409849:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961774592 00000100:00100000:3.0:1789597208.409863:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961774592 00000100:00100000:3.0:1789597208.409944:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:3.0:1789597208.409955:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+20:18745:x1876527961774592:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789597208.410369:0:22616:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789597208.410411:0:22616:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1789597208.410455:0:22616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.410477:0:22616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.410491:0:22616:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.410500:0:22616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.410506:0:22616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.410513:0:22616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789597208.410538:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789597208.410670:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d83695c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7df745ac-3f71-492a-842b-2e7c88612cac+22:18745:x1876527961774592:12345-192.168.202.16@tcp:35:lhsmtool_posix.0 Request processed in 714us (1017us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1789597208.410719:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000020:00080000:3.0:1789597208.410726:0:22616:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789597208.410846:0:22601:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789597208.410854:0:22601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.410862:0:22601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb98da000 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597208.410867:0:22601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.410876:0:22601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.410893:0:22601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9c7eb9ad5b00) 00010000:00010000:2.0:1789597208.410897:0:22601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789597208.410904:0:22601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.410910:0:22601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7eb98da000/0x7b5398e289bc0b1d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22616 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.410939:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597208.410941:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789597208.410942:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789597208.435513:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.435723:0:24126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961774720 00000100:00100000:2.0:1789597208.435737:0:24126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961774720 00000100:00100000:2.0:1789597208.435818:0:24126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:2.0:1789597208.435831:0:24126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7df745ac-3f71-492a-842b-2e7c88612cac+8:2408:x1876527961774720:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1789597208.435891:0:24126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.435919:0:24126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 8 pid: 24122 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.435930:0:24126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597208.435936:0:24126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597208.435941:0:24126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.435987:0:24126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 8 pid: 24122 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.436004:0:24126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 8 pid: 24122 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.436022:0:24126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24126:1876527984953600:192.168.202.16@tcp:104: 00000100:00100000:2.0:1789597208.436418:0:24126:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7e9280f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789597208.439889:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1789597208.439972:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.440178:0:24126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24126:1876527984953600:192.168.202.16@tcp:104: 00010000:00010000:2.0:1789597208.440215:0:24126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597208.440412:0:22600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961774976 00000100:00100000:1.0:1789597208.440420:0:22600:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961774976 00010000:00010000:1.0:1789597208.440470:0:22600:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 9 pid: 24122 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597208.440521:0:22600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:1.0:1789597208.440532:0:22600:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+9:2407:x1876527961774976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789597208.440574:0:22600:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789597208.440610:0:22600:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 9 pid: 24122 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.440640:0:22600:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 9 pid: 24122 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.440672:0:22600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000481aa9aa/0x7b5398e289bc0ae5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x93d69f46c9e07ff8 expref: 9 pid: 24122 timeout: 883 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.440739:0:22600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597208.440745:0:22600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789597208.440753:0:22600:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.440766:0:22600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789597208.440798:0:22600:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789597208.440971:0:24126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.440981:0:24126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789597208.442080:0:22600:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7df745ac-3f71-492a-842b-2e7c88612cac+8:2407:x1876527961774976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1541us (2099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597208.442106:0:22600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 21 00000100:00100000:3.0:1789597208.443315:0:24128:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789597208.443330:0:24128:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789597208.455223:0:24128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961774848 00000100:00100000:3.0:1789597208.455248:0:24128:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961774848 00000100:00100000:2.0:1789597208.458409:0:25664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1 00000100:00100000:2.0:1789597208.458435:0:25664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7df745ac-3f71-492a-842b-2e7c88612cac+9:2408:x1876527961774848:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1789597208.458502:0:25664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.458526:0:25664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597208.458530:0:25664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789597208.458537:0:25664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.458556:0:25664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789597208.557730:0:24117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1789597208.557751:0:24117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1789597208.558852:0:24126:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789597208.558865:0:24126:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1789597207 -> 1789597209 00002000:00010000:2.0:1789597208.558868:0:24126:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1789597207 -> 1789597209 00002000:00010000:2.0:1789597208.558870:0:24126:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789597208.558893:0:24126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.558909:0:24126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.558942:0:24126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.558950:0:24126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4e400 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:2.0:1789597208.558956:0:24126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.558966:0:24126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.558992:0:24126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789597208.559000:0:24126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d1b53de/0x7b5398e289bc0b24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789597208.559150:0:24126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7df745ac-3f71-492a-842b-2e7c88612cac+7:2408:x1876527961774720:12345-192.168.202.16@tcp:4:dd.0 Request processed in 123314us (123645us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789597208.559164:0:24126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 0 00000100:00100000:3.0:1789597208.575794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597208.575871:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597208.575910:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1789597208.575945:0:24123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961775744 00000100:00100000:3.0:1789597208.575959:0:24123:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961775744 00000100:00100000:3.0:1789597208.576035:0:24123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 24 00000100:00100000:3.0:1789597208.576050:0:24123:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2406:x1876527961775744:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597208.576202:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961775232 00000100:00100000:2.0:1789597208.576207:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961775232 00000100:00100000:2.0:1789597208.576248:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961775488 00000100:00100000:2.0:1789597208.576251:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961775488 00000100:00100000:2.0:1789597208.576280:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:2.0:1789597208.576287:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+5:2406:x1876527961775232:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597208.579028:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7df745ac-3f71-492a-842b-2e7c88612cac+5:2406:x1876527961775232:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 2723us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.579066:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 63 00000100:00100000:2.0:1789597208.579129:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00100000:2.0:1789597208.579145:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb5e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2406:x1876527961775488:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597208.579249:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+6:2406:x1876527961775488:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 111us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.579255:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 64 00000100:00080000:2.0:1789597208.579286:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597208.579292:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789597208.579296:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597208.579416:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.579504:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.579549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.579567:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961775616 00000100:00100000:2.0:1789597208.579577:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961775616 00000100:00100000:2.0:1789597208.579624:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00100000:2.0:1789597208.579631:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2406:x1876527961775616:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597208.579661:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2406:x1876527961775616:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 29us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.579668:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 65 00000100:00080000:2.0:1789597208.579704:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789597208.579744:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1789597208.579825:0:22608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961775104 00000100:00100000:2.0:1789597208.579829:0:22608:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961775104 00000100:00100000:2.0:1789597208.579859:0:22608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:2.0:1789597208.579866:0:22608:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:2406:x1876527961775104:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597208.579900:0:22608:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92535339-8580-4a0b-a747-d4b79f5081f6+13:2406:x1876527961775104:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.579905:0:22608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:2.0:1789597208.579935:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961775360 00000100:00100000:2.0:1789597208.579938:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961775360 00000100:00100000:2.0:1789597208.579956:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527961775872 00000100:00100000:2.0:1789597208.579957:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527961775872 00000100:00100000:2.0:1789597208.579966:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789597208.579970:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7df745ac-3f71-492a-842b-2e7c88612cac+5:2406:x1876527961775360:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597208.579987:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7df745ac-3f71-492a-842b-2e7c88612cac+5:2406:x1876527961775360:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 16us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.579991:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 25 00000100:00100000:2.0:1789597208.579997:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00100000:2.0:1789597208.580001:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2406:x1876527961775872:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1789597208.580012:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2406:x1876527961775872:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 11us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597208.580016:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 26 00000100:00080000:2.0:1789597208.580023:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789597208.582982:0:24123:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb5e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be7b4031-1e67-4349-a0a6-83f95986ed0a+5:2406:x1876527961775744:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 6917us (7052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597208.583005:0:24123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 24 00000001:00080000:1.0:1789597208.610081:0:24117:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1789597208.613475:0:25664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789597208.613583:0:25664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789597208.613606:0:25664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.613718:0:25664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.613729:0:25664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.613737:0:25664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7eb7f4fc00 already unused, calling callback (ffffffffc0e1b8b0) 00010000:00010000:0.0:1789597208.613742:0:25664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.613754:0:25664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.613784:0:25664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789597208.613793:0:25664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000baecd75a/0x7b5398e289bc0b2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789597208.614027:0:25664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e85f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7df745ac-3f71-492a-842b-2e7c88612cac+5:2408:x1876527961774848:12345-192.168.202.16@tcp:4:dd.0 Request processed in 155595us (174158us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789597208.614046:0:25664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1 00010000:00010000:2.0:1789597208.766111:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597209.021188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984953728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597209.021312:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597209.021458:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984953728 00000100:00100000:2.0:1789597209.021470:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984953728 00000100:00100000:2.0:1789597209.021560:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789597209.021572:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984953728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789597209.021624:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:2.0:1789597209.021703:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984953728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597209.021720:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789597209.021903:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597209.021960:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984953728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789597209.022215:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789597209.022226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984953856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789597209.022264:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597209.023959:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984953856 00000100:00100000:2.0:1789597209.023975:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984953856 00000100:00100000:2.0:1789597209.024054:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789597209.024066:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984953856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789597209.024149:0:22619:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1789597209.024253:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876527984953856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597209.024260:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789597209.026514:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e85f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876527984953856:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789597209.149491:0:23368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789597209.535421:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789597209.535456:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984953984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789597209.535557:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789597209.538739:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984953984 00000100:00100000:3.0:1789597209.538761:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984953984 00000100:00100000:3.0:1789597209.538935:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789597209.538949:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984953984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789597209.539004:0:23355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789597209.539142:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876527984953984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789597209.539150:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789597209.539298:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876527984953984:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789597209.791896:0:22602:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597210.563662:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984954112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597210.563758:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597210.564031:0:24125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984954112 00000100:00100000:2.0:1789597210.564038:0:24125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984954112 00000100:00100000:2.0:1789597210.564108:0:24125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597210.564118:0:24125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984954112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789597210.564149:0:24125:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789597210.564198:0:24125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876527984954112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.564206:0:24125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789597210.564228:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984954240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597210.564251:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789597210.564278:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597210.564288:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984954240 00000100:00100000:2.0:1789597210.564291:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984954240 00000100:00100000:2.0:1789597210.564313:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789597210.564318:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984954240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789597210.564329:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789597210.564386:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876527984954240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.564393:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789597210.564407:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789597210.564447:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876527984954240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789597210.564479:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876527984954112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789597210.564976:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984954496:0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.565009:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597210.565029:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebe1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984955008:0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.565051:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597210.565067:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984955520:0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.565103:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597210.565123:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789597210.565128:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984954624:0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.565148:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597210.565162:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebe1b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984955136:0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.565180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597210.565204:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7d8442e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984955648:0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.565223:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597210.565246:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984954496 00000100:00100000:1.0:1789597210.565250:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984954496 00000100:00100000:1.0:1789597210.565280:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789597210.565288:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984954496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.565330:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984954496:12345-0@lo:400:kworker.0 Request processed in 43us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597210.565336:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789597210.565365:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984954496:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.565617:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984955008 00000100:00100000:2.0:1789597210.565622:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984955008 00000100:00100000:2.0:1789597210.565659:0:24121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984954624 00000100:00100000:2.0:1789597210.565662:0:24121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984954624 00000100:00100000:2.0:1789597210.565714:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789597210.565720:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984955008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.565761:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d8442d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876527984955008:12345-0@lo:400:kworker.0 Request processed in 41us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.565767:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789597210.565781:0:24121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789597210.565787:0:24121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984954624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.565813:0:24121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876527984954624:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.565819:0:24121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789597210.565836:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984955520 00000100:00100000:2.0:1789597210.565840:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984955520 00000100:00100000:2.0:1789597210.565865:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984955136 00000100:00100000:2.0:1789597210.565868:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984955136 00000100:00100000:2.0:1789597210.565879:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984955648 00000100:00100000:2.0:1789597210.565881:0:25157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984955648 00000100:00100000:2.0:1789597210.565909:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789597210.565916:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984955520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.565954:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876527984955520:12345-0@lo:400:kworker.0 Request processed in 39us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.565960:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789597210.565972:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789597210.565978:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984955136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566002:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876527984955136:12345-0@lo:400:kworker.0 Request processed in 25us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.566008:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789597210.566018:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789597210.566023:0:25157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7ebb025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984955648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566046:0:25157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7ebb025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876527984955648:12345-0@lo:400:kworker.0 Request processed in 23us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.566051:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789597210.566115:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984954368:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566148:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597210.566174:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984954880:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566194:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597210.566215:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984955392:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566235:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597210.566251:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789597210.566257:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984954752:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566276:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597210.566291:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7eb7f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984955264:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566311:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789597210.566342:0:23355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984954880 00000100:00100000:2.0:1789597210.566347:0:23355:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984954880 00000100:00100000:2.0:1789597210.566369:0:23355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789597210.566635:0:23355:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984954880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566699:0:23355:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876527984954880:12345-0@lo:400:kworker.0 Request processed in 301us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.566706:0:23355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789597210.566727:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984955392 00000100:00100000:2.0:1789597210.566730:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984955392 00000100:00100000:2.0:1789597210.566753:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984954752 00000100:00100000:2.0:1789597210.566756:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984954752 00000100:00100000:2.0:1789597210.566768:0:22614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984955264 00000100:00100000:2.0:1789597210.566771:0:22614:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984955264 00000100:00100000:2.0:1789597210.566783:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789597210.566789:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984955392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566818:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876527984955392:12345-0@lo:400:kworker.0 Request processed in 30us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.566824:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789597210.566834:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789597210.566840:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984954752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.566864:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876527984954752:12345-0@lo:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.566870:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789597210.566880:0:22614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789597210.566885:0:22614:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7eb7f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984955264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.567192:0:22614:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7eb7f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876527984955264:12345-0@lo:400:kworker.0 Request processed in 306us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789597210.567207:0:22614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789597210.567231:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789597210.567235:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789597210.567238:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789597210.567272:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876527984954752:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.567282:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876527984955264:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.567291:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876527984954880:0@lo:400:kworker.0 00010000:00080000:2.0:1789597210.567301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7eb7f48380 x1876527984955392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597210.567312:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7eb7f48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876527984955392:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.567344:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1789597210.567349:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7e867e0380, transno 12884901892 00000004:00080000:2.0:1789597210.567359:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1789597210.567373:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876527984954624:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.568784:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebe1b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876527984955136:0@lo:400:kworker.0 00010000:00080000:2.0:1789597210.568798:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c7d8442e680 x1876527984955648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789597226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789597210.568809:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876527984955648:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.568820:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebe1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876527984955008:0@lo:400:kworker.0 00000100:00100000:2.0:1789597210.568831:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7d8442f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876527984955520:0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.568969:0:22607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984954368 00000100:00100000:1.0:1789597210.568976:0:22607:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984954368 00000100:00100000:1.0:1789597210.569024:0:22607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789597210.569032:0:22607:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:3645:x1876527984954368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789597210.569120:0:22607:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7d836ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:980ee822-f655-4df0-a283-f316bd6c264b+24:3645:x1876527984954368:12345-0@lo:400:kworker.0 Request processed in 88us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597210.569127:0:22607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789597210.569277:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7e867e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:980ee822-f655-4df0-a283-f316bd6c264b:3645:1876527984954368:0@lo:400:kworker.0 00010000:00010000:2.0:1789597210.816211:0:24578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789597211.098638:0:25701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789597211.838039:0:22601:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789597212.095825:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789597212.095850:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984955776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789597212.095914:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789597212.095961:0:24124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527984955776 00000100:00100000:1.0:1789597212.095969:0:24124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527984955776 00000100:00100000:1.0:1789597212.096024:0:24124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789597212.096033:0:24124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984955776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789597212.096071:0:24124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1789597212.096124:0:24124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7e867e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876527984955776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789597212.096131:0:24124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789597212.096152:0:22609:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789597212.096191:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7ebb025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876527984955776:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789597212.865805:0:24577:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14392 lines, 14392 kept, 0 dropped, 0 bad.